Jul 08 10:33:00 devstack cinder-volume[75709]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 10:33:00 devstack cinder-volume[75709]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 10:33:00 devstack cinder-volume[75709]: we strongly recommend against using it for new projects. Jul 08 10:33:00 devstack cinder-volume[75709]: If you are already using Eventlet, we recommend migrating to a different Jul 08 10:33:00 devstack cinder-volume[75709]: framework. For more detail see Jul 08 10:33:00 devstack cinder-volume[75709]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 10:33:00 devstack cinder-volume[75709]: import eventlet # noqa Jul 08 10:33:03 devstack cinder-volume[75709]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 10:33:03 devstack cinder-volume[75709]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 10:33:03 devstack cinder-volume[75709]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 10:33:04 devstack cinder-volume[75709]: INFO dbcounter [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Registered counter for database cinder Jul 08 10:33:04 devstack cinder-volume[75709]: DEBUG oslo_db.sqlalchemy.engines [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75709) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:33:04 devstack cinder-volume[75709]: DEBUG dbcounter [-] [75709] Writer thread running {{(pid=75709) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 10:33:04 devstack cinder-volume[75709]: INFO cinder.rpc [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 10:33:04 devstack cinder-volume[75709]: INFO cinder.rpc [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 10:33:04 devstack cinder-volume[75709]: DEBUG oslo_db.sqlalchemy.engines [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75709) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:33:04 devstack cinder-volume[75709]: INFO cinder.volume.manager [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Determined volume DB was empty at startup. Jul 08 10:33:04 devstack cinder-volume[75709]: DEBUG cinder.volume.manager [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75709) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 10:33:04 devstack cinder-volume[75709]: INFO cinder.volume.manager [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 10:33:04 devstack cinder-volume[75709]: WARNING stevedore.named [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 10:33:04 devstack cinder-volume[75709]: WARNING castellan.key_manager [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 10:33:04 devstack cinder-volume[75709]: WARNING cinder.keymgr.conf_key_mgr [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 10:33:04 devstack cinder-volume[75709]: DEBUG cinder.volume.drivers.lvm [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75709) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 10:33:04 devstack cinder-volume[75709]: DEBUG oslo_concurrency.processutils [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75709) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:04 devstack cinder-volume[75709]: DEBUG oslo_concurrency.processutils [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] CMD "cinder-rtstool verify" returned: 0 in 0.397s {{(pid=75709) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_db.sqlalchemy.engines [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75709) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:33:05 devstack cinder-volume[75709]: INFO cinder.rpc [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 10:33:05 devstack cinder-volume[75709]: INFO cinder.rpc [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 10:33:05 devstack cinder-volume[75709]: WARNING stevedore.named [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 10:33:05 devstack cinder-volume[75709]: WARNING castellan.key_manager [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 10:33:05 devstack cinder-volume[75709]: INFO cinder.volume.manager [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_db.sqlalchemy.engines [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75709) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:33:05 devstack cinder-volume[75709]: INFO oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Starting 1 workers Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Started child 75881 {{(pid=75709) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Full set of CONF: {{(pid=75709) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] ******************************************************************************** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Configuration options gathered from: {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] ================================================================================ {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] allow_availability_zone_fallback = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] allow_compression_on_image_upload = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] allowed_direct_url_schemes = [] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] api_rate_limit = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75881]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] auth_strategy = keystone {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] az_cache_duration = 3600 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_availability_zone = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_host = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_name = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_stats_polling_interval = 60 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backup_api_class = cinder.backup.api.API {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backup_name_template = backup-%s {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backup_use_same_host = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backup_use_temp_snapshot = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] chap_password = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] chap_username = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cinder_internal_tenant_project_id = ca93b26d70154561af06794c8f00bec6 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cinder_internal_tenant_user_id = 60cadd732ed74211b7ba67d9bc691a27 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cloned_volume_same_az = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cluster = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] compression_format = gzip {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] compute_api_class = cinder.compute.nova.API {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] config_dir = [] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] config_source = [] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] control_exchange = openstack {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] debug = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] default_availability_zone = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] default_group_type = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] default_volume_type = lvmdriver-1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] disk_geometry = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] driver_client_cert = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] driver_client_cert_key = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] driver_data_namespace = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] driver_ssl_cert_path = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] driver_ssl_cert_verify = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] driver_use_ssl = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] enable_force_upload = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] enable_new_services = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] enable_unsupported_driver = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] enforce_multipath_for_image_xfer = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] filter_function = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance_api_insecure = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance_api_servers = ['http://192.168.122.167/image'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance_api_ssl_compression = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance_ca_certificates_file = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance_catalog_info = image:glance:publicURL {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance_certfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance_keyfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance_num_retries = 3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance_request_timeout = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] goodness_function = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] graceful_shutdown_timeout = 5 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] group_api_class = cinder.group.api.API {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] host = devstack {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] image_compress_on_upload = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] image_conversion_address_space_limit = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] image_conversion_cpu_limit = 60 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] image_conversion_disable = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] image_upload_use_cinder_backend = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] image_upload_use_internal_tenant = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] image_volume_cache_enabled = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] image_volume_cache_max_count = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] image_volume_cache_max_size_gb = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] init_host_max_objects_retrieval = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] instance_format = [instance: %(uuid)s] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] iscsi_target_flags = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] iscsi_write_cache = on {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] iser_helper = tgtadm {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] iser_ip_address = 192.168.122.167 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] iser_port = 3260 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] log_color = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] log_config_append = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] log_dir = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] log_file = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] log_options = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] log_rotate_interval = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] log_rotate_interval_type = days {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] log_rotation_type = none {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75881]: INFO cinder.volume.manager [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] max_age = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] max_logfile_count = 30 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] max_logfile_size_mb = 200 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack sudo[75886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 10:33:05 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:05 devstack sudo[75886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] max_over_subscription_ratio = 20.0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] message_reap_interval = 86400 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] message_ttl = 2592000 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] migration_create_volume_timeout_secs = 300 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] monkey_patch = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] monkey_patch_modules = [] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] my_ip = 192.168.122.167 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] no_snapshot_gb_quota = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] num_iser_scan_tries = 3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] num_shell_tries = 3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] num_volume_device_scan_tries = 3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] nvmeof_conn_info_version = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] nvmet_ns_id = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] nvmet_port_id = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] osapi_max_limit = 1000 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] osapi_volume_ext_list = [] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] osapi_volume_listen_port = 8776 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] osapi_volume_use_ssl = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] osapi_volume_workers = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] per_volume_size_limit = -1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] periodic_fuzzy_delay = 60 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] periodic_interval = 60 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] public_endpoint = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] publish_errors = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] quota_backup_gigabytes = 1000 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] quota_backups = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] quota_gigabytes = 1000 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] quota_groups = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] quota_snapshots = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] quota_volumes = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] rate_limit_burst = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] rate_limit_except_level = CRITICAL {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] rate_limit_interval = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] reinit_driver_count = 3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] replication_device = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] report_discard_supported = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] report_interval = 120 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] reservation_clean_interval = 86400 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] reservation_expire = 86400 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] reserved_image_namespaces = [] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] reserved_percentage = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] rpc_response_timeout = 120 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] run_external_periodic_tasks = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] scst_target_driver = iscsi {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] scst_target_iqn_name = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] service_down_time = 720 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] shell_completion = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] snapshot_name_template = snapshot-%s {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] snapshot_same_host = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] split_loggers = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] state_path = /opt/stack/data/cinder {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] storage_availability_zone = nova {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] storage_protocol = iSCSI {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] syslog_log_facility = LOG_USER {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] target_helper = lioadm {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] target_ip_address = 192.168.122.167 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] target_port = 3260 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] target_protocol = iscsi {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] target_secondary_ip_addresses = [] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] trace_flags = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] transport_url = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] until_refresh = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] use_chap_auth = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] use_default_quota_class = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] use_journal = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] use_json = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] use_multipath_for_image_xfer = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] use_stderr = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] use_syslog = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] verify_glance_signatures = enabled {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_api_class = cinder.volume.api.API {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_backend_name = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_clear = zero {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_clear_ionice = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_clear_size = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_copy_bps_limit = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_dd_blocksize = 1M {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_name_template = volume-%s {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_service_inithost_offload = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volume_usage_audit_period = month {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] zoning_mode = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_concurrency.disable_process_locking = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.auth_section = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.auth_type = password {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.auth_version = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.064s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.cache = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.certfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.include_service_catalog = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.insecure = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.interface = public {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.keyfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_password = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcache_username = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.region_name = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.service_type = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.167/identity {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.backend = dogpile.cache.null {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.backend_argument = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.backend_expiration_time = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.config_prefix = cache.oslo {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.debug_cache_backend = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.enable_retry_client = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.enable_socket_keepalive = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.enabled = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.expiration_time = 600 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.hashclient_retry_attempts = 2 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.memcache_dead_retry = 300 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.memcache_pool_maxsize = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.memcache_sasl_enabled = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.password = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.proxies = [] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.redis_db = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.redis_server = localhost:6379 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.retry_attempts = 2 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.retry_delay = 0.0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.socket_keepalive_count = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.socket_keepalive_idle = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:05 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.socket_keepalive_interval = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.socket_timeout = 1.0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.tls_allowed_ciphers = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.tls_cafile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.tls_certfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.tls_enabled = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.tls_keyfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cache.username = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] coordination.backend_url = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.asyncio_connection = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.asyncio_slave_connection = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.backend = sqlalchemy {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.connection = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.connection_debug = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.connection_parameters = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.connection_recycle_time = 3600 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.connection_trace = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.db_inc_retry_interval = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.db_max_retries = 20 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.db_max_retry_interval = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.db_retry_interval = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.max_overflow = 50 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.max_pool_size = 5 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.max_retries = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.mysql_wsrep_sync_wait = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.pool_timeout = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.retry_interval = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.slave_connection = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.sqlite_synchronous = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.synchronous_reader = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] database.use_db_reconnect = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:05 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler.connection_string = messaging:// {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler.enabled = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler.es_doc_type = notification {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler.es_scroll_size = 10000 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler.es_scroll_time = 2m {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler.filter_error_trace = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler.hmac_keys = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler.sentinel_service_name = mymaster {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler.socket_timeout = 0.1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler.trace_requests = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler.trace_sqlalchemy = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler_jaeger.process_tags = {} {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler_jaeger.service_name_prefix = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] profiler_otlp.service_name_prefix = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_policy.enforce_new_defaults = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_policy.enforce_scope = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_policy.policy_default_rule = default {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_policy.policy_file = policy.yaml {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] privsep_osbrick.group = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] privsep_osbrick.helper_command = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] privsep_osbrick.user = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cinder_sys_admin.group = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cinder_sys_admin.helper_command = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] cinder_sys_admin.user = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] service_user.auth_section = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] service_user.auth_type = password {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] service_user.cafile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] service_user.certfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] service_user.collect_timing = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] service_user.insecure = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] service_user.keyfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] service_user.send_service_user_token = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] service_user.split_loggers = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] service_user.timeout = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance.auth_section = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance.auth_type = password {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance.certfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance.collect_timing = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance.insecure = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance.keyfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance.region_name = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance.split_loggers = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] glance.timeout = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.backend_availability_zone = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.chap_password = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.chap_username = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.disk_geometry = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.driver_client_cert = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.driver_client_cert_key = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.driver_data_namespace = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.driver_use_ssl = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.extra_capabilities = {} {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.filter_function = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.goodness_function = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.iscsi_target_flags = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.iscsi_write_cache = on {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.iser_helper = tgtadm {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.iser_ip_address = 192.168.122.167 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.iser_port = 3260 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.lvm_share_target = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.lvm_type = auto {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.num_shell_tries = 3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.replication_device = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.report_discard_supported = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.reserved_percentage = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.target_helper = tgtadm {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.target_ip_address = 192.168.122.167 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.target_port = 3260 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.target_protocol = iscsi {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.trace_flags = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.unique_fqdn_network = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.use_chap_auth = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.volume_backend_name = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.volume_clear = zero {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.volume_clear_ionice = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.volume_clear_size = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_reports.file_event_handler = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_reports.log_dir = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.backend_host = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.chap_password = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.chap_username = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.disk_geometry = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.driver_client_cert = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.extra_capabilities = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.filter_function = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.goodness_function = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.iser_helper = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.iser_ip_address = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.iser_port = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.lvm_share_target = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.lvm_type = auto {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.num_shell_tries = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.replication_device = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.report_discard_supported = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.reserved_percentage = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.scst_target_driver = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.storage_protocol = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.target_helper = lioadm {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.target_ip_address = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.target_port = 3260 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.trace_flags = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.use_chap_auth = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.volume_clear = zero {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.volume_clear_size = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] lvmdriver-1.volumes_dir = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.ssl = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_notifications.driver = [] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_notifications.retry = -1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] key_manager.fixed_key = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.barbican_api_version = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.barbican_endpoint = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.barbican_endpoint_type = public {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.barbican_region_name = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.cafile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.certfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.collect_timing = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.insecure = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.keyfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.number_of_retries = 60 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.retry_delay = 1 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.send_service_user_token = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.split_loggers = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.timeout = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.verify_ssl = True {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican.verify_ssl_path = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican_service_user.auth_section = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican_service_user.auth_type = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican_service_user.cafile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican_service_user.certfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican_service_user.collect_timing = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican_service_user.insecure = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican_service_user.keyfile = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican_service_user.split_loggers = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] barbican_service_user.timeout = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vault.approle_role_id = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vault.approle_secret_id = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vault.kv_mountpoint = secret {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vault.kv_path = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vault.kv_version = 2 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vault.namespace = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vault.root_token_id = **** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vault.ssl_ca_crt_file = None {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vault.timeout = 60.0 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vault.use_ssl = False {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:33:06 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] ******************************************************************************** {{(pid=75709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 10:33:06 devstack sudo[75886]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:06 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.867s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:06 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:06 devstack sudo[75891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:33:06 devstack sudo[75891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:06 devstack sudo[75891]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:06 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.661s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:06 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:33:06 devstack cinder-volume[75881]: INFO cinder.brick.local_dev.lvm [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 10:33:06 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:07 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:07 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:07 devstack sudo[76143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 10:33:07 devstack sudo[76143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:07 devstack sudo[76143]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:07 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.732s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:07 devstack cinder-volume[75881]: DEBUG cinder.brick.local_dev.lvm [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75881) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 10:33:07 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:07 devstack sudo[76445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:33:07 devstack sudo[76445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:09 devstack sudo[76445]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:09 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.374s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:09 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:09 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:09 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:09 devstack sudo[76661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:33:09 devstack sudo[76661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:09 devstack sudo[76661]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:09 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.769s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:09 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:09 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:09 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:09 devstack sudo[76667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 10:33:09 devstack sudo[76667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:10 devstack sudo[76667]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:10 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.766s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:10 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:10 devstack sudo[76671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 10:33:10 devstack sudo[76671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:11 devstack sudo[76671]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:11 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:11 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:11 devstack sudo[76683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 10:33:11 devstack sudo[76683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:12 devstack sudo[76683]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:12 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.936s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:12 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:12 devstack sudo[76689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:33:12 devstack sudo[76689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:13 devstack sudo[76689]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:13 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.018s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:13 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:13 devstack sudo[76694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:33:13 devstack sudo[76694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:14 devstack sudo[76694]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:14 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.742s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:14 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:14 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:14 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:14 devstack sudo[76704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:33:14 devstack sudo[76704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:14 devstack sudo[76704]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:14 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.848s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:14 devstack cinder-volume[75881]: INFO cinder.volume.drivers.lvm [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 10:33:14 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:15 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:15 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:15 devstack sudo[76825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:33:15 devstack sudo[76825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:15 devstack cinder-volume[75709]: DEBUG dbcounter [-] [75709] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75709) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:33:15 devstack sudo[76825]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:15 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.680s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:15 devstack cinder-volume[75881]: DEBUG cinder.volume.drivers.lvm [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Updating volume stats {{(pid=75881) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 10:33:15 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:15 devstack sudo[76945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 10:33:15 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:16 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:16 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.687s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:16 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:16 devstack sudo[76969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:33:16 devstack sudo[76969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:17 devstack sudo[76969]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:17 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:17 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:17 devstack sudo[76972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:33:17 devstack sudo[76972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:17 devstack sudo[76972]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:17 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:17 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:17 devstack sudo[76976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:33:17 devstack sudo[76976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:18 devstack sudo[76976]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:18 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:18 devstack cinder-volume[75881]: INFO cinder.volume.driver [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Driver hasn't implemented _init_vendor_properties() Jul 08 10:33:18 devstack cinder-volume[75881]: DEBUG cinder.volume.driver [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75881) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 10:33:18 devstack cinder-volume[75881]: DEBUG oslo_db.sqlalchemy.engines [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75881) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:33:18 devstack cinder-volume[75881]: DEBUG dbcounter [-] [75881] Writer thread running {{(pid=75881) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 10:33:18 devstack cinder-volume[75881]: DEBUG cinder.db.api [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Building query based on filter {{(pid=75881) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 10:33:18 devstack cinder-volume[75881]: DEBUG cinder.image.image_utils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75881) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 10:33:18 devstack cinder-volume[75881]: INFO cinder.keymgr.migration [None req-70749734-095a-448d-a95a-51e22a1140c5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 10:33:18 devstack cinder-volume[75881]: DEBUG cinder.volume.drivers.lvm [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Updating volume stats {{(pid=75881) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 10:33:18 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:18 devstack sudo[76981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 10:33:18 devstack sudo[76981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:19 devstack sudo[76981]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:19 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:19 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:19 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:33:19 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:19 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:19 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:19 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:19 devstack sudo[76991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:33:19 devstack sudo[76991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:20 devstack sudo[76991]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:20 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.685s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:20 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:20 devstack sudo[76995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:33:20 devstack sudo[76995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:21 devstack sudo[76995]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:21 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:21 devstack cinder-volume[75881]: DEBUG cinder.manager [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Notifying Schedulers of capabilities ... {{(pid=75881) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:33:21 devstack cinder-volume[75881]: INFO cinder.volume.manager [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Driver initialization completed successfully. Jul 08 10:33:21 devstack cinder-volume[75881]: INFO cinder.manager [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Initiating service 2 cleanup Jul 08 10:33:21 devstack cinder-volume[75881]: INFO cinder.manager [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Service 2 cleanup completed. Jul 08 10:33:21 devstack cinder-volume[75881]: DEBUG cinder.service [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Creating RPC server for service cinder-volume {{(pid=75881) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 10:33:21 devstack cinder-volume[75881]: DEBUG cinder.service [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75881) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 10:33:21 devstack cinder-volume[75881]: INFO cinder.volume.manager [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 10:33:21 devstack cinder-volume[75881]: DEBUG cinder.volume.drivers.lvm [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Updating volume stats {{(pid=75881) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 10:33:21 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:21 devstack sudo[76999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 10:33:21 devstack sudo[76999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:22 devstack sudo[76999]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:22 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:22 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:22 devstack sudo[77002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:33:22 devstack sudo[77002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:22 devstack sudo[77002]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:22 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:22 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:22 devstack sudo[77062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:33:22 devstack sudo[77062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:23 devstack sudo[77062]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:23 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:23 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:33:23 devstack sudo[77065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:33:23 devstack sudo[77065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:33:23 devstack sudo[77065]: pam_unix(sudo:session): session closed for user root Jul 08 10:33:23 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:33:23 devstack cinder-volume[75881]: INFO cinder.volume.manager [None req-60751e00-aa8b-4da5-a0fc-5e94e6eba9bd None None] Driver post RPC initialization completed successfully. Jul 08 10:33:33 devstack cinder-volume[75881]: DEBUG dbcounter [-] [75881] Writing DB stats cinder:SELECT=4 {{(pid=75881) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:33:34 devstack cinder-volume[75881]: DEBUG dbcounter [-] [75881] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75881) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:34:22 devstack cinder-volume[75881]: DEBUG oslo_service.periodic_task [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75881) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:34:22 devstack cinder-volume[75881]: DEBUG cinder.volume.drivers.lvm [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Updating volume stats {{(pid=75881) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 10:34:22 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:34:23 devstack sudo[78771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 10:34:23 devstack sudo[78771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:34:23 devstack sudo[78771]: pam_unix(sudo:session): session closed for user root Jul 08 10:34:23 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:34:23 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:34:23 devstack sudo[78801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:34:23 devstack sudo[78801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:34:24 devstack sudo[78801]: pam_unix(sudo:session): session closed for user root Jul 08 10:34:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:34:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:34:24 devstack sudo[78804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:34:24 devstack sudo[78804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:34:24 devstack sudo[78804]: pam_unix(sudo:session): session closed for user root Jul 08 10:34:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:34:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:34:24 devstack sudo[78807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:34:24 devstack sudo[78807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:34:25 devstack sudo[78807]: pam_unix(sudo:session): session closed for user root Jul 08 10:34:25 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:34:25 devstack cinder-volume[75881]: DEBUG cinder.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Notifying Schedulers of capabilities ... {{(pid=75881) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:34:25 devstack cinder-volume[75881]: DEBUG oslo_service.periodic_task [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running periodic task VolumeManager._thread_info {{(pid=75881) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:34:25 devstack cinder-volume[75881]: DEBUG cinder.volume.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] thread count: 6 {{(pid=75881) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:34:25 devstack cinder-volume[75881]: DEBUG cinder.volume.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] thread info: [<_MainThread(MainThread, started 137072737054848)>, , , , , ] {{(pid=75881) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:35:22 devstack cinder-volume[75881]: DEBUG oslo_service.periodic_task [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75881) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:35:22 devstack cinder-volume[75881]: DEBUG cinder.volume.drivers.lvm [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Updating volume stats {{(pid=75881) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 10:35:22 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:35:23 devstack sudo[82119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 10:35:23 devstack sudo[82119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:35:23 devstack sudo[82119]: pam_unix(sudo:session): session closed for user root Jul 08 10:35:23 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.726s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:35:23 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:35:23 devstack sudo[82139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:35:23 devstack sudo[82139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:35:24 devstack sudo[82139]: pam_unix(sudo:session): session closed for user root Jul 08 10:35:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:35:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:35:24 devstack sudo[82158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:35:24 devstack sudo[82158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:35:25 devstack sudo[82158]: pam_unix(sudo:session): session closed for user root Jul 08 10:35:25 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:35:25 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:35:25 devstack sudo[82163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:35:25 devstack sudo[82163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:35:25 devstack sudo[82163]: pam_unix(sudo:session): session closed for user root Jul 08 10:35:25 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:35:25 devstack cinder-volume[75881]: DEBUG cinder.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Notifying Schedulers of capabilities ... {{(pid=75881) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:35:25 devstack cinder-volume[75881]: DEBUG oslo_service.periodic_task [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running periodic task VolumeManager._thread_info {{(pid=75881) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:35:25 devstack cinder-volume[75881]: DEBUG cinder.volume.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] thread count: 6 {{(pid=75881) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:35:25 devstack cinder-volume[75881]: DEBUG cinder.volume.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] thread info: [<_MainThread(MainThread, started 137072737054848)>, , , , , ] {{(pid=75881) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:35:33 devstack cinder-volume[75881]: DEBUG dbcounter [-] [75881] Writing DB stats cinder:SELECT=1 {{(pid=75881) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:35:34 devstack cinder-volume[75881]: DEBUG dbcounter [-] [75881] Writing DB stats cinder:UPDATE=1 {{(pid=75881) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:36:22 devstack cinder-volume[75881]: DEBUG oslo_service.periodic_task [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75881) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:36:22 devstack cinder-volume[75881]: DEBUG cinder.volume.drivers.lvm [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Updating volume stats {{(pid=75881) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 10:36:22 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:36:23 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 10:36:23 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:36:23 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Jul 08 10:36:23 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:36:23 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:36:23 devstack sudo[84168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:36:23 devstack sudo[84168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:36:24 devstack sudo[84168]: pam_unix(sudo:session): session closed for user root Jul 08 10:36:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:36:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:36:24 devstack sudo[84173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:36:24 devstack sudo[84173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:36:24 devstack sudo[84173]: pam_unix(sudo:session): session closed for user root Jul 08 10:36:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:36:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:36:24 devstack sudo[84187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:36:24 devstack sudo[84187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:36:25 devstack sudo[84187]: pam_unix(sudo:session): session closed for user root Jul 08 10:36:25 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:36:25 devstack cinder-volume[75881]: DEBUG cinder.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Notifying Schedulers of capabilities ... {{(pid=75881) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:36:25 devstack cinder-volume[75881]: DEBUG oslo_service.periodic_task [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running periodic task VolumeManager._thread_info {{(pid=75881) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:36:25 devstack cinder-volume[75881]: DEBUG cinder.volume.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] thread count: 6 {{(pid=75881) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:36:25 devstack cinder-volume[75881]: DEBUG cinder.volume.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] thread info: [<_MainThread(MainThread, started 137072737054848)>, , , , , ] {{(pid=75881) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:37:22 devstack cinder-volume[75881]: DEBUG oslo_service.periodic_task [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75881) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:37:22 devstack cinder-volume[75881]: DEBUG cinder.volume.drivers.lvm [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Updating volume stats {{(pid=75881) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 10:37:22 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:37:23 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 10:37:23 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:37:23 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Jul 08 10:37:23 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:37:23 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:37:23 devstack sudo[85466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:37:23 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:37:24 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root Jul 08 10:37:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:37:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:37:24 devstack sudo[85470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 10:37:24 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:37:24 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root Jul 08 10:37:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:37:24 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:37:24 devstack sudo[85484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 10:37:24 devstack sudo[85484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:37:25 devstack sudo[85484]: pam_unix(sudo:session): session closed for user root Jul 08 10:37:25 devstack cinder-volume[75881]: DEBUG oslo_concurrency.processutils [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:37:25 devstack cinder-volume[75881]: DEBUG cinder.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Notifying Schedulers of capabilities ... {{(pid=75881) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:37:25 devstack cinder-volume[75881]: DEBUG oslo_service.periodic_task [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] Running periodic task VolumeManager._thread_info {{(pid=75881) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:37:25 devstack cinder-volume[75881]: DEBUG cinder.volume.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] thread count: 6 {{(pid=75881) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:37:25 devstack cinder-volume[75881]: DEBUG cinder.volume.manager [None req-d45c85eb-1281-4708-96d2-268225cc2813 None None] thread info: [<_MainThread(MainThread, started 137072737054848)>, , , , , ] {{(pid=75881) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:37:34 devstack cinder-volume[75881]: DEBUG dbcounter [-] [75881] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75881) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:37:42 devstack cinder-volume[75709]: INFO oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Caught SIGTERM, stopping children Jul 08 10:37:42 devstack cinder-volume[75709]: DEBUG oslo_concurrency.lockutils [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Acquiring lock "singleton_lock" {{(pid=75709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 10:37:42 devstack cinder-volume[75709]: DEBUG oslo_concurrency.lockutils [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Acquired lock "singleton_lock" {{(pid=75709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 10:37:42 devstack cinder-volume[75709]: DEBUG oslo_concurrency.lockutils [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Releasing lock "singleton_lock" {{(pid=75709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 10:37:42 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Stop services. {{(pid=75709) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 10:37:42 devstack cinder-volume[75709]: DEBUG oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Killing children. {{(pid=75709) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 10:37:42 devstack cinder-volume[75709]: INFO oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Waiting on 1 children to exit Jul 08 10:37:46 devstack cinder-volume[75881]: DEBUG oslo_concurrency.lockutils [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Acquiring lock "singleton_lock" {{(pid=75881) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 10:37:46 devstack cinder-volume[75881]: DEBUG oslo_concurrency.lockutils [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Acquired lock "singleton_lock" {{(pid=75881) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 10:37:46 devstack cinder-volume[75881]: DEBUG oslo_concurrency.lockutils [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Releasing lock "singleton_lock" {{(pid=75881) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 10:37:46 devstack cinder-volume[75881]: WARNING amqp [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 10:37:46 devstack cinder-volume[75881]: WARNING amqp [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 10:37:46 devstack cinder-volume[75709]: INFO oslo_service.backend._eventlet.service [None req-00477f17-464f-4efb-a991-634eaae1f133 None None] Child 75881 exited with status 0 Jul 08 10:37:46 devstack cinder-volume[86008]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 10:37:46 devstack cinder-volume[86008]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 10:37:46 devstack cinder-volume[86008]: we strongly recommend against using it for new projects. Jul 08 10:37:46 devstack cinder-volume[86008]: If you are already using Eventlet, we recommend migrating to a different Jul 08 10:37:46 devstack cinder-volume[86008]: framework. For more detail see Jul 08 10:37:46 devstack cinder-volume[86008]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 10:37:46 devstack cinder-volume[86008]: import eventlet # noqa Jul 08 10:37:48 devstack cinder-volume[86008]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86008) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 10:37:48 devstack cinder-volume[86008]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86008) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 10:37:48 devstack cinder-volume[86008]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86008) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 10:37:49 devstack cinder-volume[86008]: INFO dbcounter [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Registered counter for database cinder Jul 08 10:37:49 devstack cinder-volume[86008]: DEBUG oslo_db.sqlalchemy.engines [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86008) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:37:49 devstack cinder-volume[86008]: DEBUG dbcounter [-] [86008] Writer thread running {{(pid=86008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 10:37:49 devstack cinder-volume[86008]: INFO cinder.rpc [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 10:37:49 devstack cinder-volume[86008]: INFO cinder.rpc [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 10:37:49 devstack cinder-volume[86008]: DEBUG oslo_db.sqlalchemy.engines [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86008) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:37:50 devstack cinder-volume[86008]: INFO cinder.volume.manager [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Determined volume DB was empty at startup. Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG cinder.volume.manager [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86008) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 10:37:50 devstack cinder-volume[86008]: INFO cinder.volume.manager [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 10:37:50 devstack cinder-volume[86008]: WARNING stevedore.named [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 10:37:50 devstack cinder-volume[86008]: WARNING castellan.key_manager [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 10:37:50 devstack cinder-volume[86008]: WARNING cinder.keymgr.conf_key_mgr [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 10:37:50 devstack cinder-volume[86008]: INFO cinder.volume.manager [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_db.sqlalchemy.engines [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86008) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:37:50 devstack cinder-volume[86008]: INFO oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Starting 1 workers Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Started child 86228 {{(pid=86008) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Full set of CONF: {{(pid=86008) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] ******************************************************************************** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Configuration options gathered from: {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] ================================================================================ {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] allow_availability_zone_fallback = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] allow_compression_on_image_upload = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86228]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] allowed_direct_url_schemes = [] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] api_rate_limit = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] auth_strategy = keystone {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_availability_zone = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_host = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_name = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_stats_polling_interval = 60 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backup_api_class = cinder.backup.api.API {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backup_name_template = backup-%s {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backup_use_same_host = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backup_use_temp_snapshot = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] chap_password = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] chap_username = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cinder_internal_tenant_project_id = ca93b26d70154561af06794c8f00bec6 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cinder_internal_tenant_user_id = 60cadd732ed74211b7ba67d9bc691a27 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cluster = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] compression_format = gzip {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] compute_api_class = cinder.compute.nova.API {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] config_dir = [] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] config_source = [] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] control_exchange = openstack {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] debug = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] default_availability_zone = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] default_group_type = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] default_volume_type = QuobyteHD {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] disk_geometry = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] driver_client_cert = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] driver_client_cert_key = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] driver_data_namespace = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] driver_ssl_cert_path = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] driver_ssl_cert_verify = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] driver_use_ssl = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] enable_new_services = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] enable_unsupported_driver = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] enabled_backends = ['QuobyteHD'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] enforce_multipath_for_image_xfer = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] filter_function = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance_api_insecure = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance_api_servers = ['http://192.168.122.167/image'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance_api_ssl_compression = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance_ca_certificates_file = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance_catalog_info = image:glance:publicURL {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance_certfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance_keyfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance_num_retries = 3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance_request_timeout = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] goodness_function = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] graceful_shutdown_timeout = 5 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] group_api_class = cinder.group.api.API {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] host = devstack {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] image_compress_on_upload = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] image_conversion_address_space_limit = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] image_conversion_cpu_limit = 60 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] image_conversion_disable = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] image_upload_use_cinder_backend = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] image_upload_use_internal_tenant = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] image_volume_cache_enabled = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] image_volume_cache_max_count = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] image_volume_cache_max_size_gb = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] init_host_max_objects_retrieval = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] instance_format = [instance: %(uuid)s] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] iscsi_target_flags = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] iscsi_write_cache = on {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] iser_helper = tgtadm {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] iser_ip_address = 192.168.122.167 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86228]: INFO cinder.volume.manager [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 10:37:50 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.remotefs [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86228) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] iser_port = 3260 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] log_color = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] log_config_append = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] log_dir = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] log_file = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] log_options = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] log_rotate_interval = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] log_rotate_interval_type = days {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] log_rotation_type = none {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] max_age = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] max_logfile_count = 30 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] max_logfile_size_mb = 200 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] max_over_subscription_ratio = 20.0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] message_reap_interval = 86400 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] message_ttl = 2592000 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] migration_create_volume_timeout_secs = 300 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] monkey_patch = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] monkey_patch_modules = [] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] my_ip = 192.168.122.167 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] no_snapshot_gb_quota = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] num_iser_scan_tries = 3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] num_shell_tries = 3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] num_volume_device_scan_tries = 3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] nvmeof_conn_info_version = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] nvmet_ns_id = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] nvmet_port_id = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] osapi_max_limit = 1000 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] osapi_volume_ext_list = [] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] osapi_volume_listen = 0.0.0.0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] osapi_volume_listen_port = 8776 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] osapi_volume_use_ssl = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] osapi_volume_workers = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] per_volume_size_limit = -1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] periodic_fuzzy_delay = 60 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] periodic_interval = 60 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] project_id_regex = [0-9a-f\-]+ {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] public_endpoint = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] publish_errors = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] quota_backup_gigabytes = 1000 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] quota_backups = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] quota_gigabytes = 1000 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] quota_groups = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] quota_snapshots = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] quota_volumes = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] rate_limit_burst = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] rate_limit_except_level = CRITICAL {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] rate_limit_interval = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] reinit_driver_count = 3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] replication_device = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] report_discard_supported = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] report_interval = 120 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] reservation_clean_interval = 86400 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] reservation_expire = 86400 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] reserved_image_namespaces = [] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] reserved_percentage = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] rpc_response_timeout = 120 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] run_external_periodic_tasks = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] scst_target_driver = iscsi {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] scst_target_iqn_name = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] service_down_time = 720 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] shell_completion = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] snapshot_name_template = snapshot-%s {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] split_loggers = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] state_path = /opt/stack/data/cinder {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] storage_availability_zone = nova {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] storage_protocol = iSCSI {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] syslog_log_facility = LOG_USER {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] target_helper = lioadm {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] target_ip_address = 192.168.122.167 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] target_port = 3260 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] target_protocol = iscsi {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] target_secondary_ip_addresses = [] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] trace_flags = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] transfer_api_class = cinder.transfer.api.API {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] transport_url = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] until_refresh = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] use_chap_auth = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] use_default_quota_class = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] use_journal = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] use_json = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] use_multipath_for_image_xfer = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] use_stderr = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] use_syslog = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] verify_glance_signatures = enabled {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_api_class = cinder.volume.api.API {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_backend_name = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_clear = zero {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_clear_ionice = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_clear_size = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_copy_bps_limit = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_dd_blocksize = 1M {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_name_template = volume-%s {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_service_inithost_offload = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volume_usage_audit_period = month {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] zoning_mode = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_concurrency.disable_process_locking = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.auth_section = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.auth_type = password {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.auth_version = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.cache = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.certfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.delay_auth_decision = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.http_connect_timeout = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.include_service_catalog = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.insecure = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.interface = public {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.keyfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_password = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcache_username = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.region_name = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.service_token_roles_required = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.service_type = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.token_cache_time = 300 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.167/identity {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.backend = dogpile.cache.null {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.backend_argument = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.backend_expiration_time = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.config_prefix = cache.oslo {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.debug_cache_backend = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.enable_retry_client = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.enable_socket_keepalive = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.enabled = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.expiration_time = 600 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.hashclient_retry_attempts = 2 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.memcache_dead_retry = 300 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.memcache_pool_maxsize = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86228) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 10:37:50 devstack cinder-volume[86228]: WARNING cinder.volume.drivers.quobyte [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 10:37:50 devstack cinder-volume[86228]: WARNING cinder.volume.drivers.quobyte [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.memcache_sasl_enabled = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.password = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.proxies = [] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.redis_db = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.redis_sentinel_service_name = mymaster {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Running cmd (subprocess): mount.quobyte {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.redis_server = localhost:6379 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.retry_attempts = 2 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.retry_delay = 0.0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.socket_keepalive_count = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.socket_keepalive_idle = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.socket_keepalive_interval = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.socket_timeout = 1.0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.tls_allowed_ciphers = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.tls_cafile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.tls_certfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.tls_enabled = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.tls_keyfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cache.username = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] coordination.backend_url = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.asyncio_connection = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.asyncio_slave_connection = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.backend = sqlalchemy {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.connection = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.connection_debug = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.connection_parameters = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.connection_recycle_time = 3600 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.connection_trace = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.db_inc_retry_interval = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.db_max_retries = 20 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.db_max_retry_interval = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.db_retry_interval = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.max_overflow = 50 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.max_pool_size = 5 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.max_retries = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.mysql_wsrep_sync_wait = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.pool_timeout = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.retry_interval = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.slave_connection = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.sqlite_synchronous = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.synchronous_reader = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] database.use_db_reconnect = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler.connection_string = messaging:// {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler.enabled = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler.es_doc_type = notification {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler.es_scroll_size = 10000 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler.es_scroll_time = 2m {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler.filter_error_trace = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler.hmac_keys = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler.sentinel_service_name = mymaster {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler.socket_timeout = 0.1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler.trace_requests = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler.trace_sqlalchemy = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler_jaeger.process_tags = {} {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler_jaeger.service_name_prefix = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] profiler_otlp.service_name_prefix = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_policy.enforce_new_defaults = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_policy.enforce_scope = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_policy.policy_default_rule = default {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_policy.policy_file = policy.yaml {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_policy.remote_timeout = 60.0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] privsep_osbrick.group = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] privsep_osbrick.helper_command = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] privsep_osbrick.user = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cinder_sys_admin.group = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cinder_sys_admin.helper_command = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] cinder_sys_admin.user = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] service_user.auth_section = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] service_user.auth_type = password {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] service_user.cafile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] service_user.certfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] service_user.collect_timing = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] service_user.insecure = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] service_user.keyfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] service_user.send_service_user_token = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] service_user.split_loggers = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] service_user.timeout = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance.auth_section = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance.auth_type = password {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance.certfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance.collect_timing = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance.insecure = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance.keyfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance.region_name = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance.split_loggers = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] glance.timeout = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.backend_availability_zone = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.chap_password = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.chap_username = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.disk_geometry = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.driver_client_cert = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.driver_client_cert_key = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.driver_data_namespace = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.driver_use_ssl = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.enable_unsupported_driver = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.extra_capabilities = {} {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.filter_function = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.goodness_function = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.iscsi_target_flags = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.iscsi_write_cache = on {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.iser_helper = tgtadm {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.iser_ip_address = 192.168.122.167 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.iser_port = 3260 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nas_host = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nas_login = admin {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nas_mount_options = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nas_password = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nas_private_key = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nas_share_path = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nas_ssh_port = 22 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.num_shell_tries = 3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.nvmet_port_id = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.quobyte_client_cfg = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.quobyte_volume_url = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.replication_device = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.report_discard_supported = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.reserved_percentage = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.scst_target_driver = iscsi {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.scst_target_iqn_name = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.storage_protocol = iSCSI {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.target_helper = tgtadm {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.target_ip_address = 192.168.122.167 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.target_port = 3260 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.target_protocol = iscsi {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.trace_flags = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.unique_fqdn_network = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.use_chap_auth = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.volume_backend_name = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.volume_clear = zero {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.volume_clear_ionice = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.volume_clear_size = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_reports.file_event_handler = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_reports.log_dir = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.backend_availability_zone = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.backend_host = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.chap_password = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.chap_username = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.chiscsi_conf = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.disk_geometry = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.driver_client_cert = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.driver_client_cert_key = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.driver_data_namespace = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.driver_use_ssl = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.extra_capabilities = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.filter_function = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.goodness_function = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack quobyte-client[86230]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.iscsi_target_flags = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.iscsi_write_cache = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.iser_helper = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack quobyte-client[86230]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.iser_ip_address = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.iser_port = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.iser_target_prefix = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nas_host = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nas_login = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nas_mount_options = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nas_password = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nas_private_key = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nas_share_path = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nas_ssh_port = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.num_shell_tries = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nvmet_ns_id = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.nvmet_port_id = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.replication_device = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.report_discard_supported = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.reserved_percentage = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.scst_target_driver = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.storage_protocol = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.target_helper = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.target_ip_address = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.target_port = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.target_prefix = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.target_protocol = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.trace_flags = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.unique_fqdn_network = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.use_chap_auth = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.volume_clear = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.volume_clear_ionice = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.volume_clear_size = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] QuobyteHD.volumes_dir = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] CMD "mount.quobyte" returned: 1 in 0.140s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:37:50 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:37:50 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:37:50 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86228]: INFO cinder.volume.drivers.quobyte [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 ... Jul 08 10:37:50 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d -c /etc/quobyte/client-cinder.cfg {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.ssl = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.ssl_version = {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_notifications.driver = [] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_notifications.retry = -1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] oslo_messaging_notifications.transport_url = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] key_manager.fixed_key = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.barbican_api_version = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.barbican_endpoint = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.barbican_endpoint_type = public {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.barbican_region_name = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.cafile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.certfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.collect_timing = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.insecure = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.keyfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.number_of_retries = 60 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.retry_delay = 1 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.send_service_user_token = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.split_loggers = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.timeout = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.verify_ssl = True {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican.verify_ssl_path = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican_service_user.auth_section = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican_service_user.auth_type = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican_service_user.cafile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican_service_user.certfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican_service_user.collect_timing = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican_service_user.insecure = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican_service_user.keyfile = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican_service_user.split_loggers = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] barbican_service_user.timeout = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vault.approle_role_id = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vault.approle_secret_id = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vault.kv_mountpoint = secret {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vault.kv_path = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vault.kv_version = 2 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vault.namespace = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vault.root_token_id = **** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vault.ssl_ca_crt_file = None {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vault.timeout = 60.0 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vault.use_ssl = False {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:37:50 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] ******************************************************************************** {{(pid=86008) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 10:37:50 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d -c /etc/quobyte/client-cinder.cfg Jul 08 10:37:50 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:37:51 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Jul 08 10:37:51 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.776s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:37:51 devstack cinder-volume[86228]: INFO cinder.volume.drivers.quobyte [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 succeeded Jul 08 10:37:51 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:37:51 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.788s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:37:51 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:37:51 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:37:51 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:37:51 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Jul 08 10:37:51 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.637s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:37:51 devstack cinder-volume[86228]: INFO cinder.volume.driver [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Driver hasn't implemented _init_vendor_properties() Jul 08 10:37:51 devstack cinder-volume[86228]: DEBUG cinder.volume.driver [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7446327209473, 'free_capacity_gb': 1775.7446327209473, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86228) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG oslo_db.sqlalchemy.engines [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG dbcounter [-] [86228] Writer thread running {{(pid=86228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG cinder.db.api [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Building query based on filter {{(pid=86228) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG cinder.image.image_utils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86228) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 10:37:52 devstack cinder-volume[86228]: INFO cinder.keymgr.migration [None req-53da0a66-6b70-429b-93e8-c87e5051f805 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:37:52 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:37:52 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:37:52 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.665s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG cinder.manager [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Notifying Schedulers of capabilities ... {{(pid=86228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:37:52 devstack cinder-volume[86228]: INFO cinder.volume.manager [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Driver initialization completed successfully. Jul 08 10:37:52 devstack cinder-volume[86228]: INFO cinder.manager [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Initiating service 3 cleanup Jul 08 10:37:52 devstack cinder-volume[86228]: INFO cinder.manager [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Service 3 cleanup completed. Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG cinder.service [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Creating RPC server for service cinder-volume {{(pid=86228) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG cinder.service [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86228) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 10:37:52 devstack cinder-volume[86228]: INFO cinder.volume.manager [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:37:52 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:37:53 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:37:53 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:37:53 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:37:53 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:37:53 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:37:53 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Jul 08 10:37:53 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.844s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:37:53 devstack cinder-volume[86228]: INFO cinder.volume.manager [None req-765c5d98-d6cb-44fd-a47a-e81a6cd9da0b None None] Driver post RPC initialization completed successfully. Jul 08 10:37:58 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-026b7924-defd-4547-8207-d43f7a4c3345 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:37:58 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-026b7924-defd-4547-8207-d43f7a4c3345 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:37:58 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-026b7924-defd-4547-8207-d43f7a4c3345 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:37:58 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-026b7924-defd-4547-8207-d43f7a4c3345 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:37:58 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-026b7924-defd-4547-8207-d43f7a4c3345 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:37:58 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-026b7924-defd-4547-8207-d43f7a4c3345 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:37:58 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:37:58 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:37:58 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Jul 08 10:37:58 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-026b7924-defd-4547-8207-d43f7a4c3345 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.676s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:37:58 devstack cinder-volume[86228]: DEBUG cinder.manager [None req-026b7924-defd-4547-8207-d43f7a4c3345 None None] Notifying Schedulers of capabilities ... {{(pid=86228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:38:00 devstack cinder-volume[86008]: INFO oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Caught SIGTERM, stopping children Jul 08 10:38:00 devstack cinder-volume[86008]: DEBUG oslo_concurrency.lockutils [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Acquiring lock "singleton_lock" {{(pid=86008) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 10:38:00 devstack cinder-volume[86008]: DEBUG oslo_concurrency.lockutils [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Acquired lock "singleton_lock" {{(pid=86008) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 10:38:00 devstack cinder-volume[86008]: DEBUG oslo_concurrency.lockutils [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Releasing lock "singleton_lock" {{(pid=86008) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 10:38:00 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Stop services. {{(pid=86008) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 10:38:00 devstack cinder-volume[86008]: DEBUG oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Killing children. {{(pid=86008) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 10:38:00 devstack cinder-volume[86008]: INFO oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Waiting on 1 children to exit Jul 08 10:38:01 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Acquiring lock "singleton_lock" {{(pid=86228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 10:38:01 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Acquired lock "singleton_lock" {{(pid=86228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 10:38:01 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Releasing lock "singleton_lock" {{(pid=86228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 10:38:01 devstack cinder-volume[86228]: WARNING amqp [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 10:38:01 devstack cinder-volume[86228]: WARNING amqp [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 10:38:01 devstack cinder-volume[86008]: INFO oslo_service.backend._eventlet.service [None req-2cf43f19-c2d5-45c5-a3ff-1f3d223febae None None] Child 86228 exited with status 0 Jul 08 10:38:01 devstack cinder-volume[86664]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 10:38:01 devstack cinder-volume[86664]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 10:38:01 devstack cinder-volume[86664]: we strongly recommend against using it for new projects. Jul 08 10:38:01 devstack cinder-volume[86664]: If you are already using Eventlet, we recommend migrating to a different Jul 08 10:38:01 devstack cinder-volume[86664]: framework. For more detail see Jul 08 10:38:01 devstack cinder-volume[86664]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 10:38:01 devstack cinder-volume[86664]: import eventlet # noqa Jul 08 10:38:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86664) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 10:38:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86664) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 10:38:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86664) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 10:38:05 devstack cinder-volume[86664]: INFO dbcounter [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Registered counter for database cinder Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_db.sqlalchemy.engines [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86664) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writer thread running {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 10:38:05 devstack cinder-volume[86664]: INFO cinder.rpc [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 10:38:05 devstack cinder-volume[86664]: INFO cinder.rpc [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_db.sqlalchemy.engines [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86664) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:38:05 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Determined volume DB was empty at startup. Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86664) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 10:38:05 devstack cinder-volume[86664]: WARNING stevedore.named [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 10:38:05 devstack cinder-volume[86664]: WARNING castellan.key_manager [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 10:38:05 devstack cinder-volume[86664]: WARNING cinder.keymgr.conf_key_mgr [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 10:38:05 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_db.sqlalchemy.engines [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86664) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:38:05 devstack cinder-volume[86664]: INFO oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Starting 1 workers Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Started child 86913 {{(pid=86664) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Full set of CONF: {{(pid=86664) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] ******************************************************************************** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] Configuration options gathered from: {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] ================================================================================ {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] allow_availability_zone_fallback = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] allow_compression_on_image_upload = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] allowed_direct_url_schemes = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] api_rate_limit = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] auth_strategy = keystone {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_availability_zone = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_host = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_stats_polling_interval = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backup_api_class = cinder.backup.api.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backup_name_template = backup-%s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backup_use_same_host = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backup_use_temp_snapshot = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] chap_password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] chap_username = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cinder_internal_tenant_project_id = ca93b26d70154561af06794c8f00bec6 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cinder_internal_tenant_user_id = 60cadd732ed74211b7ba67d9bc691a27 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86913]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cluster = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] compression_format = gzip {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] compute_api_class = cinder.compute.nova.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] config_dir = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] config_source = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] control_exchange = openstack {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] debug = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] default_availability_zone = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] default_group_type = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] default_volume_type = QuobyteHD {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] disk_geometry = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] driver_client_cert = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] driver_client_cert_key = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] driver_data_namespace = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] driver_ssl_cert_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] driver_ssl_cert_verify = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] driver_use_ssl = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] enable_new_services = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] enable_unsupported_driver = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] enabled_backends = ['QuobyteHD'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] enforce_multipath_for_image_xfer = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] filter_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance_api_insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance_api_servers = ['http://192.168.122.167/image'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance_api_ssl_compression = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance_ca_certificates_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance_catalog_info = image:glance:publicURL {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance_certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance_keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance_num_retries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance_request_timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] goodness_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] graceful_shutdown_timeout = 5 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] group_api_class = cinder.group.api.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] host = devstack {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] image_compress_on_upload = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] image_conversion_address_space_limit = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] image_conversion_cpu_limit = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] image_conversion_disable = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] image_upload_use_cinder_backend = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] image_upload_use_internal_tenant = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] image_volume_cache_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] image_volume_cache_max_count = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] image_volume_cache_max_size_gb = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] init_host_max_objects_retrieval = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] instance_format = [instance: %(uuid)s] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] iscsi_target_flags = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] iscsi_write_cache = on {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] iser_helper = tgtadm {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] iser_ip_address = 192.168.122.167 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] iser_port = 3260 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] log_color = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] log_config_append = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] log_dir = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] log_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] log_options = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] log_rotate_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] log_rotate_interval_type = days {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] log_rotation_type = none {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] max_age = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] max_logfile_count = 30 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] max_logfile_size_mb = 200 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] max_over_subscription_ratio = 20.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] message_reap_interval = 86400 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] message_ttl = 2592000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] migration_create_volume_timeout_secs = 300 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] monkey_patch = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] monkey_patch_modules = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] my_ip = 192.168.122.167 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] no_snapshot_gb_quota = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] num_iser_scan_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] num_shell_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] num_volume_device_scan_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] nvmeof_conn_info_version = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] nvmet_ns_id = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] nvmet_port_id = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] osapi_max_limit = 1000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] osapi_volume_ext_list = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] osapi_volume_listen_port = 8776 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] osapi_volume_use_ssl = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] osapi_volume_workers = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] per_volume_size_limit = -1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] periodic_fuzzy_delay = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] periodic_interval = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] public_endpoint = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] publish_errors = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] quota_backup_gigabytes = 1000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] quota_backups = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] quota_gigabytes = 1000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] quota_groups = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] quota_snapshots = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] quota_volumes = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] rate_limit_burst = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] rate_limit_except_level = CRITICAL {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] rate_limit_interval = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] reinit_driver_count = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] replication_device = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] report_discard_supported = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] report_interval = 120 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] reservation_clean_interval = 86400 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] reservation_expire = 86400 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] reserved_image_namespaces = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] reserved_percentage = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] rpc_response_timeout = 120 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] run_external_periodic_tasks = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] scst_target_driver = iscsi {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] scst_target_iqn_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] service_down_time = 720 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] shell_completion = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] snapshot_name_template = snapshot-%s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] split_loggers = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] state_path = /opt/stack/data/cinder {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] storage_availability_zone = nova {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] storage_protocol = iSCSI {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] syslog_log_facility = LOG_USER {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] target_helper = lioadm {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] target_ip_address = 192.168.122.167 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] target_port = 3260 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] target_protocol = iscsi {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] target_secondary_ip_addresses = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] trace_flags = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] transport_url = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] until_refresh = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] use_chap_auth = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] use_default_quota_class = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] use_journal = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] use_json = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] use_multipath_for_image_xfer = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] use_stderr = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] use_syslog = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] verify_glance_signatures = enabled {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:05 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_api_class = cinder.volume.api.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_backend_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_clear = zero {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_clear_ionice = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_clear_size = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_copy_bps_limit = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_dd_blocksize = 1M {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_name_template = volume-%s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_service_inithost_offload = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volume_usage_audit_period = month {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] zoning_mode = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_concurrency.disable_process_locking = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86913) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.auth_section = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.auth_type = password {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.auth_version = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.cache = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.include_service_catalog = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.interface = public {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_password = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcache_username = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.region_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.service_type = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.167/identity {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.backend = dogpile.cache.null {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.backend_argument = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.backend_expiration_time = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.config_prefix = cache.oslo {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.debug_cache_backend = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.enable_retry_client = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.enable_socket_keepalive = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.expiration_time = 600 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.hashclient_retry_attempts = 2 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.memcache_dead_retry = 300 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.memcache_pool_maxsize = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.memcache_sasl_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.proxies = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.redis_db = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.redis_server = localhost:6379 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.retry_attempts = 2 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.retry_delay = 0.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.socket_keepalive_count = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.socket_keepalive_idle = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.socket_keepalive_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.socket_timeout = 1.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.tls_allowed_ciphers = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.tls_cafile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.tls_certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.tls_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.tls_keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cache.username = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] coordination.backend_url = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.asyncio_connection = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.asyncio_slave_connection = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.backend = sqlalchemy {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.connection = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.connection_debug = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.connection_parameters = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.connection_recycle_time = 3600 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.connection_trace = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.db_inc_retry_interval = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.db_max_retries = 20 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.db_max_retry_interval = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.db_retry_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.max_overflow = 50 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.max_pool_size = 5 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.max_retries = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.mysql_wsrep_sync_wait = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.pool_timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.retry_interval = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.slave_connection = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.sqlite_synchronous = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.synchronous_reader = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] database.use_db_reconnect = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler.connection_string = messaging:// {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler.enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler.es_doc_type = notification {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler.es_scroll_size = 10000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler.es_scroll_time = 2m {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler.filter_error_trace = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler.hmac_keys = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler.sentinel_service_name = mymaster {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler.socket_timeout = 0.1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler.trace_requests = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler.trace_sqlalchemy = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler_jaeger.process_tags = {} {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler_jaeger.service_name_prefix = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] profiler_otlp.service_name_prefix = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_policy.enforce_new_defaults = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_policy.enforce_scope = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_policy.policy_default_rule = default {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_policy.policy_file = policy.yaml {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] privsep_osbrick.group = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] privsep_osbrick.helper_command = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] privsep_osbrick.user = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cinder_sys_admin.group = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cinder_sys_admin.helper_command = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] cinder_sys_admin.user = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86913) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 10:38:06 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.quobyte [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 10:38:06 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.quobyte [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 10:38:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Running cmd (subprocess): mount.quobyte {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] service_user.auth_section = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] service_user.auth_type = password {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] service_user.cafile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] service_user.certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] service_user.collect_timing = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] service_user.insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] service_user.keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] service_user.send_service_user_token = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] service_user.split_loggers = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] service_user.timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance.auth_section = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance.auth_type = password {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance.certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance.collect_timing = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance.insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance.keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance.region_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance.split_loggers = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] glance.timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.backend_availability_zone = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.chap_password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.chap_username = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.disk_geometry = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.driver_client_cert = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.driver_client_cert_key = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.driver_data_namespace = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.driver_use_ssl = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.extra_capabilities = {} {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.filter_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.goodness_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.iscsi_target_flags = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.iscsi_write_cache = on {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.iser_helper = tgtadm {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.iser_ip_address = 192.168.122.167 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.iser_port = 3260 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nas_host = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nas_login = admin {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nas_mount_options = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nas_password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nas_private_key = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nas_share_path = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.num_shell_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.quobyte_volume_url = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.replication_device = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.report_discard_supported = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.reserved_percentage = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.target_helper = tgtadm {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.target_ip_address = 192.168.122.167 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.target_port = 3260 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.target_protocol = iscsi {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.trace_flags = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.unique_fqdn_network = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.use_chap_auth = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.volume_backend_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.volume_clear = zero {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.volume_clear_ionice = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.volume_clear_size = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_reports.file_event_handler = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_reports.log_dir = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.backend_availability_zone = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.backend_host = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.chap_password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.chap_username = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.chiscsi_conf = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.disk_geometry = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.driver_client_cert = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.driver_data_namespace = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.driver_use_ssl = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.extra_capabilities = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.filter_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.goodness_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.iser_helper = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.iser_ip_address = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.iser_port = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.iser_target_prefix = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nas_host = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nas_login = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nas_mount_options = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nas_password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nas_private_key = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nas_share_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nas_ssh_port = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.num_shell_tries = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] CMD "mount.quobyte" returned: 1 in 0.131s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:38:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:38:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:38:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.nvmet_port_id = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.replication_device = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.report_discard_supported = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.reserved_percentage = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.scst_target_driver = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:38:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.storage_protocol = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.target_helper = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.target_ip_address = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.target_port = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.target_prefix = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.target_protocol = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.trace_flags = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.use_chap_auth = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.volume_clear = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.volume_clear_size = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] QuobyteHD.volumes_dir = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.ssl = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_notifications.driver = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_notifications.retry = -1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] key_manager.fixed_key = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.barbican_api_version = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.barbican_endpoint = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.barbican_endpoint_type = public {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.barbican_region_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.cafile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.collect_timing = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.number_of_retries = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.retry_delay = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.send_service_user_token = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.split_loggers = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.verify_ssl = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican.verify_ssl_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican_service_user.auth_section = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican_service_user.auth_type = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican_service_user.cafile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican_service_user.certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican_service_user.collect_timing = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican_service_user.insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican_service_user.keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican_service_user.split_loggers = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] barbican_service_user.timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vault.approle_role_id = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vault.approle_secret_id = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vault.kv_mountpoint = secret {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vault.kv_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vault.kv_version = 2 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vault.namespace = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vault.root_token_id = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vault.ssl_ca_crt_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vault.timeout = 60.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vault.use_ssl = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 10:38:06 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-7f736458-1c88-4c72-98b5-40c9a3c70a60 None None] ******************************************************************************** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 10:38:07 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Jul 08 10:38:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.406s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:38:07 devstack cinder-volume[86913]: INFO cinder.volume.driver [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 10:38:07 devstack cinder-volume[86913]: DEBUG cinder.volume.driver [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7446327209473, 'free_capacity_gb': 1775.7446327209473, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86913) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG oslo_db.sqlalchemy.engines [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86913) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writer thread running {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG cinder.db.api [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Building query based on filter {{(pid=86913) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86913) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:38:08 devstack cinder-volume[86913]: INFO cinder.keymgr.migration [None req-8a20335b-cc51-43b0-bb05-2ae694ab3e17 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 10:38:08 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:38:08 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:38:08 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.820s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:38:08 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:38:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Driver initialization completed successfully. Jul 08 10:38:09 devstack cinder-volume[86913]: INFO cinder.manager [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Initiating service 3 cleanup Jul 08 10:38:09 devstack cinder-volume[86913]: INFO cinder.manager [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Service 3 cleanup completed. Jul 08 10:38:09 devstack cinder-volume[86913]: DEBUG cinder.service [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Creating RPC server for service cinder-volume {{(pid=86913) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 10:38:09 devstack cinder-volume[86913]: DEBUG cinder.service [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86913) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 10:38:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 10:38:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:38:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:38:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:38:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:38:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:38:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:38:09 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:38:09 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:38:09 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Jul 08 10:38:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.682s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:38:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-aa09c618-3c03-4bb3-9d6f-45510c71d025 None None] Driver post RPC initialization completed successfully. Jul 08 10:38:15 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:38:19 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:38:19 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=3 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:38:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:38:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 6 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:38:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Flow 'volume_create_manager' (e4259466-7d10-4412-92dc-5c90a4336083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d7fa0c-c6ae-464c-b203-a7b8b4a9e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d7fa0c-c6ae-464c-b203-a7b8b4a9e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1546259298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128754dc-413b-4a03-968e-f2811c701fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a131ac3fb4684f78b400f6caddcc006c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:39:32Z,use_quota=True,user_id='e761185caad5439e814cd8dc9a89426a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f753f7e-dd20-4c19-9a03-0aa779f62bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f753f7e-dd20-4c19-9a03-0aa779f62bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f8a420-9d23-45b2-9082-505ee8857ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f8a420-9d23-45b2-9082-505ee8857ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '128754dc-413b-4a03-968e-f2811c701fa0', 'volume_name': 'volume-128754dc-413b-4a03-968e-f2811c701fa0', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0b8c09-2d46-44c0-8889-5595e79e5793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0b8c09-2d46-44c0-8889-5595e79e5793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28deec77-1457-4282-9927-c781f1fbcd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:32 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Volume 128754dc-413b-4a03-968e-f2811c701fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-128754dc-413b-4a03-968e-f2811c701fa0', 'volume_size': 1} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1546259298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128754dc-413b-4a03-968e-f2811c701fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a131ac3fb4684f78b400f6caddcc006c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:39:32Z,use_quota=True,user_id='e761185caad5439e814cd8dc9a89426a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Creating volume 128754dc-413b-4a03-968e-f2811c701fa0 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:39:32 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:39:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:39:32 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0 1073741824 Jul 08 10:39:32 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:39:34 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:39:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Flow 'volume_create_manager' (b5083172-c72a-432b-a854-34fd94692395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:39:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a7e4b9-4c13-4425-8a49-2b597738ca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a7e4b9-4c13-4425-8a49-2b597738ca7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2110307075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942b97b4-48a3-4018-92ec-31eb3eb8ecfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6d44b1e9b240e781e4297c96ac00cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:39:35Z,use_quota=True,user_id='5aa6857c8fbe4e65a94ffc6bd0a85b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc73354-bd57-44e4-8647-c73907ba98ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc73354-bd57-44e4-8647-c73907ba98ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0aad951-0da1-41e6-aa38-c6d57f860efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0aad951-0da1-41e6-aa38-c6d57f860efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942b97b4-48a3-4018-92ec-31eb3eb8ecfc', 'volume_name': 'volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:35 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Jul 08 10:39:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b515f9b5-3a53-41b2-a199-36c745e50fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b515f9b5-3a53-41b2-a199-36c745e50fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f831ffa9-5fca-44c5-b44d-77081554bdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:35 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Volume 942b97b4-48a3-4018-92ec-31eb3eb8ecfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc', 'volume_size': 1} Jul 08 10:39:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:39:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0 1073741824" returned: 0 in 2.648s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:39:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:39:35 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0 Jul 08 10:39:35 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:39:36 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0" returned: 0 in 1.618s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] <== create_volume: return (4421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.427s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.777s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2110307075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942b97b4-48a3-4018-92ec-31eb3eb8ecfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6d44b1e9b240e781e4297c96ac00cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:39:35Z,use_quota=True,user_id='5aa6857c8fbe4e65a94ffc6bd0a85b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Creating volume 942b97b4-48a3-4018-92ec-31eb3eb8ecfc {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:39:36 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:39:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:39:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28deec77-1457-4282-9927-c781f1fbcd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128754dc-413b-4a03-968e-f2811c701fa0', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:37 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc 1073741824 Jul 08 10:39:37 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:39:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaade1d-9282-4433-938c-22cf342e17bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:37 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Volume volume-128754dc-413b-4a03-968e-f2811c701fa0 (128754dc-413b-4a03-968e-f2811c701fa0): created successfully Jul 08 10:39:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaade1d-9282-4433-938c-22cf342e17bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Flow 'volume_create_manager' (e4259466-7d10-4412-92dc-5c90a4336083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:39:37 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2e3dfbf7-d97e-4e5d-aa5b-9129245d13a7 tempest-DeleteServersTestJSON-1714713527 None] Created volume successfully. Jul 08 10:39:38 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Jul 08 10:39:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc 1073741824" returned: 0 in 1.867s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:39:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:39:39 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc Jul 08 10:39:39 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:39:40 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Jul 08 10:39:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc" returned: 0 in 1.289s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:39:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] <== create_volume: return (3408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:39:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.422s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:39:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f831ffa9-5fca-44c5-b44d-77081554bdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70bca9d-2a19-470e-8e22-3ded5e96d84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:39:40 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Volume volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc (942b97b4-48a3-4018-92ec-31eb3eb8ecfc): created successfully Jul 08 10:39:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70bca9d-2a19-470e-8e22-3ded5e96d84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:39:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Flow 'volume_create_manager' (b5083172-c72a-432b-a854-34fd94692395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:39:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-216d9546-7ed4-4e32-8641-6c344a29de0c tempest-VolumesAdminNegativeTest-1200404256 None] Created volume successfully. Jul 08 10:39:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Acquiring lock "cinder-942b97b4-48a3-4018-92ec-31eb3eb8ecfc-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:39:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Lock "cinder-942b97b4-48a3-4018-92ec-31eb3eb8ecfc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:39:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Acquiring lock "cinder-quobyte-942b97b4-48a3-4018-92ec-31eb3eb8ecfc" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:39:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Lock "cinder-quobyte-942b97b4-48a3-4018-92ec-31eb3eb8ecfc" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:39:42 devstack cinder-volume[86913]: INFO oslo.privsep.daemon [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5atn4cyu/privsep.sock'] Jul 08 10:39:42 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5atn4cyu/privsep.sock Jul 08 10:39:42 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:39:43 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 10:39:43 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 10:39:43 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 10:39:43 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 10:39:43 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 10:39:43 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 10:39:43 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 10:39:43 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 10:39:43 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 10:39:45 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 10:39:45 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 10:39:45 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 10:39:45 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 10:39:45 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 10:39:45 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 10:39:45 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 10:39:45 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 10:39:45 devstack cinder-volume[86913]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 10:39:46 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Jul 08 10:39:46 devstack cinder-volume[86913]: INFO oslo.privsep.daemon [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Spawned new privsep daemon via rootwrap Jul 08 10:39:46 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Accepted privsep connection to /tmp/tmp5atn4cyu/privsep.sock {{(pid=86913) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 10:39:46 devstack cinder-volume[86913]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 10:39:46 devstack cinder-volume[86913]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 10:39:46 devstack cinder-volume[86913]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 10:39:46 devstack cinder-volume[86913]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88000 Jul 08 10:39:46 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3bf510-e419-42ff-9887-b8e5fa87f261]: (2,) {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:39:46 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[401f8fc0-d7ea-46f3-a3fd-7f6c7c419562]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:39:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:39:46 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc Jul 08 10:39:46 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:39:47 devstack cinder-volume[86913]: WARNING py.warnings [req-f04e89a8-4be7-42cb-89b6-90b59ee61669 req-7b2db638-d48d-4644-a69b-1c0bf8529730 tempest-DeleteServersTestJSON-1714713527 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 08 10:39:47 devstack cinder-volume[86913]: .first() Jul 08 10:39:47 devstack cinder-volume[86913]: Jul 08 10:39:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f04e89a8-4be7-42cb-89b6-90b59ee61669 req-7b2db638-d48d-4644-a69b-1c0bf8529730 tempest-DeleteServersTestJSON-1714713527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:39:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f04e89a8-4be7-42cb-89b6-90b59ee61669 req-7b2db638-d48d-4644-a69b-1c0bf8529730 tempest-DeleteServersTestJSON-1714713527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:39:47 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0b10c8-9b0b-4ab0-84f5-de53412d60a7]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:39:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f04e89a8-4be7-42cb-89b6-90b59ee61669 req-7b2db638-d48d-4644-a69b-1c0bf8529730 tempest-DeleteServersTestJSON-1714713527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:39:47 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0 Jul 08 10:39:47 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:39:48 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Jul 08 10:39:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc" returned: 0 in 1.943s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:39:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:39:48 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc Jul 08 10:39:48 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:39:49 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Jul 08 10:39:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f04e89a8-4be7-42cb-89b6-90b59ee61669 req-7b2db638-d48d-4644-a69b-1c0bf8529730 tempest-DeleteServersTestJSON-1714713527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0" returned: 0 in 1.734s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:39:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f04e89a8-4be7-42cb-89b6-90b59ee61669 req-7b2db638-d48d-4644-a69b-1c0bf8529730 tempest-DeleteServersTestJSON-1714713527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.765s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:39:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f04e89a8-4be7-42cb-89b6-90b59ee61669 req-7b2db638-d48d-4644-a69b-1c0bf8529730 tempest-DeleteServersTestJSON-1714713527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-128754dc-413b-4a03-968e-f2811c701fa0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9dac7cab-f564-45fa-92b6-ab908f1d7684', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:39:49 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-f04e89a8-4be7-42cb-89b6-90b59ee61669 req-7b2db638-d48d-4644-a69b-1c0bf8529730 tempest-DeleteServersTestJSON-1714713527 None] attachment_update completed successfully. Jul 08 10:39:50 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Jul 08 10:39:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-942b97b4-48a3-4018-92ec-31eb3eb8ecfc" returned: 0 in 1.816s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:39:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Lock "cinder-quobyte-942b97b4-48a3-4018-92ec-31eb3eb8ecfc" released by "delete_volume" :: held 7.318s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:39:50 devstack cinder-volume[86913]: WARNING cinder.quota [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:39:50 devstack cinder-volume[86913]: WARNING cinder.quota [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:39:50 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Created reservations ['afbe8a99-5562-4617-ad75-aceafdedcbe4', '46a82326-07ef-4105-a8eb-68b84383c3c2', 'ab882060-70aa-44ba-9e2b-8aa13b477585', 'fd151f8b-34fd-4351-8ef2-8c858fd9aa6d'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:39:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:39:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:39:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:39:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:39:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:39:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:39:50 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:39:50 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:39:51 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Jul 08 10:39:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.350s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:39:51 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:39:51 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Deleted volume successfully. Jul 08 10:39:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-53f4d3cd-08e5-4679-9bcf-97a9b3dccf5b tempest-VolumesAdminNegativeTest-1200404256 None] Lock "cinder-942b97b4-48a3-4018-92ec-31eb3eb8ecfc-delete_volume" released by "delete_volume" :: held 9.279s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:39:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:39:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:39:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:39:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:39:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:39:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:39:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:39:53 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:39:53 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:39:54 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Jul 08 10:39:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.970s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:39:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:39:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:39:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 8 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:39:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:39:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-aea1141e-c2c5-4e99-b8ae-f54d3db003ec req-ab4172d9-2932-4263-8d75-71f7e69b9e85 tempest-DeleteServersTestJSON-1714713527 None] Terminate volume connection completed successfully. Jul 08 10:39:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-aea1141e-c2c5-4e99-b8ae-f54d3db003ec req-ab4172d9-2932-4263-8d75-71f7e69b9e85 tempest-DeleteServersTestJSON-1714713527 None] Deleting attachment 9dac7cab-f564-45fa-92b6-ab908f1d7684. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:40:00 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=14,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:40:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Acquiring lock "cinder-128754dc-413b-4a03-968e-f2811c701fa0-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:40:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Lock "cinder-128754dc-413b-4a03-968e-f2811c701fa0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:40:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Acquiring lock "cinder-quobyte-128754dc-413b-4a03-968e-f2811c701fa0" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:40:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Lock "cinder-quobyte-128754dc-413b-4a03-968e-f2811c701fa0" acquired by "delete_volume" :: waited 0.034s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:40:07 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f14528f-6348-4f75-855e-896397f9329b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:40:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:40:07 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0 Jul 08 10:40:07 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:40:08 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Jul 08 10:40:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0" returned: 0 in 0.979s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:40:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:40:08 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0 Jul 08 10:40:08 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:40:08 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Jul 08 10:40:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-128754dc-413b-4a03-968e-f2811c701fa0" returned: 0 in 0.716s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:40:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Lock "cinder-quobyte-128754dc-413b-4a03-968e-f2811c701fa0" released by "delete_volume" :: held 1.759s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:40:09 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Created reservations ['168f39df-c88e-40e5-9e67-4ab9896e64ce', '32d68e39-0a65-4a06-addc-e1b928a5f9d4', 'f7dad8bd-dee2-4485-a3be-bc79ded6b443', '249834f5-b5f8-4c6c-8dec-c0f54118f5e2'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:40:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:40:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:40:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:40:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:40:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:40:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:40:09 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:40:09 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:40:10 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Jul 08 10:40:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.050s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:40:10 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:40:10 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Deleted volume successfully. Jul 08 10:40:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ca1a9a3f-2aa1-487c-912c-716e30bf44eb tempest-DeleteServersTestJSON-1714713527 None] Lock "cinder-128754dc-413b-4a03-968e-f2811c701fa0-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Flow 'volume_create_manager' (fbd3415a-fd2e-4236-8ef4-e39eaad3e3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b1eff2-8230-499f-87e6-ee6c1bdf2bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b1eff2-8230-499f-87e6-ee6c1bdf2bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1287224606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab1468a-bc9e-4423-8632-6b4b2835692e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2336a3b0ac4c48e89e01b57a73259fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:40:15Z,use_quota=True,user_id='2d7df21bf45444959ed705b1c64672fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1070e5b9-8f14-46ff-9e29-614ed16603d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1070e5b9-8f14-46ff-9e29-614ed16603d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0a5871-e827-4ab2-bec4-30abb324d34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0a5871-e827-4ab2-bec4-30abb324d34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab1468a-bc9e-4423-8632-6b4b2835692e', 'volume_name': 'volume-fab1468a-bc9e-4423-8632-6b4b2835692e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54cd778-debc-4eda-a703-225c85e4d6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54cd778-debc-4eda-a703-225c85e4d6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a937b96-781c-4ebf-a367-e3206aa7fc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:14 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Volume fab1468a-bc9e-4423-8632-6b4b2835692e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab1468a-bc9e-4423-8632-6b4b2835692e', 'volume_size': 1} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1287224606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab1468a-bc9e-4423-8632-6b4b2835692e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2336a3b0ac4c48e89e01b57a73259fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:40:15Z,use_quota=True,user_id='2d7df21bf45444959ed705b1c64672fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Creating volume fab1468a-bc9e-4423-8632-6b4b2835692e {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:40:14 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:40:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:40:15 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e 1073741824 Jul 08 10:40:15 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:40:16 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Jul 08 10:40:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e 1073741824" returned: 0 in 1.828s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:40:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:40:16 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e Jul 08 10:40:16 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:40:18 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Jul 08 10:40:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e" returned: 0 in 1.647s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:40:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] <== create_volume: return (3565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:40:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.574s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:40:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a937b96-781c-4ebf-a367-e3206aa7fc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab1468a-bc9e-4423-8632-6b4b2835692e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76def136-2448-429f-b985-d57f95c0b23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:18 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Volume volume-fab1468a-bc9e-4423-8632-6b4b2835692e (fab1468a-bc9e-4423-8632-6b4b2835692e): created successfully Jul 08 10:40:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76def136-2448-429f-b985-d57f95c0b23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Flow 'volume_create_manager' (fbd3415a-fd2e-4236-8ef4-e39eaad3e3b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:40:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c17d30e2-cb46-495b-93e4-39d38a95cb47 tempest-AttachVolumeShelveTestJSON-1193191986 None] Created volume successfully. Jul 08 10:40:28 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=11 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:40:28 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=23,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Flow 'volume_create_manager' (fcc7fbe2-d2e4-4c34-a2ac-c4d3658c2cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36293e6-a343-4712-8d87-6881a90d32d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36293e6-a343-4712-8d87-6881a90d32d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1177363157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b51461-d304-4c1d-b804-d4484dbda0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710a18f1a42b4963988540820e2fab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:40:42Z,use_quota=True,user_id='815d84526a7248e3bb1ae8014184c1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd231d6f-6454-4718-8243-8897689107d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd231d6f-6454-4718-8243-8897689107d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9b368a-f62b-4e8e-8e71-1595f4258436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9b368a-f62b-4e8e-8e71-1595f4258436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63b51461-d304-4c1d-b804-d4484dbda0cb', 'volume_name': 'volume-63b51461-d304-4c1d-b804-d4484dbda0cb', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db349ee7-83af-4a02-a1c6-fc3cbbf4a520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db349ee7-83af-4a02-a1c6-fc3cbbf4a520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd6e0f7-5b39-43ee-84e6-21c20f0ef8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:41 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Volume 63b51461-d304-4c1d-b804-d4484dbda0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63b51461-d304-4c1d-b804-d4484dbda0cb', 'volume_size': 1} Jul 08 10:40:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:40:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:40:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1177363157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b51461-d304-4c1d-b804-d4484dbda0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710a18f1a42b4963988540820e2fab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:40:42Z,use_quota=True,user_id='815d84526a7248e3bb1ae8014184c1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:40:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Creating volume 63b51461-d304-4c1d-b804-d4484dbda0cb {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:40:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:40:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:40:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:40:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:40:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:40:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:40:42 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:40:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:40:42 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb 1073741824 Jul 08 10:40:42 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:40:43 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Jul 08 10:40:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb 1073741824" returned: 0 in 1.495s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:40:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:40:43 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb Jul 08 10:40:43 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:40:44 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Jul 08 10:40:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb" returned: 0 in 0.981s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:40:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] <== create_volume: return (2566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:40:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.568s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:40:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd6e0f7-5b39-43ee-84e6-21c20f0ef8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63b51461-d304-4c1d-b804-d4484dbda0cb', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01b9bd4-0f66-424b-a12d-06d67cfd5ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:44 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Volume volume-63b51461-d304-4c1d-b804-d4484dbda0cb (63b51461-d304-4c1d-b804-d4484dbda0cb): created successfully Jul 08 10:40:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01b9bd4-0f66-424b-a12d-06d67cfd5ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Flow 'volume_create_manager' (fcc7fbe2-d2e4-4c34-a2ac-c4d3658c2cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:40:44 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0ddb23cf-0e1d-48ed-85ad-c44edc560576 tempest-ServerRescueNegativeTestJSON-1743132947 None] Created volume successfully. Jul 08 10:40:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-7f4b87d3-5935-45fd-b970-d9a8b63ad02c req-74d15b97-670f-426f-8a66-81593bc322bd tempest-AttachVolumeShelveTestJSON-1193191986 None] No connector for attachment 634f42a8-ad66-4062-a0b7-25f2187609c4; skipping storage backend terminate_connection call. {{(pid=86913) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 10:40:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-7f4b87d3-5935-45fd-b970-d9a8b63ad02c req-74d15b97-670f-426f-8a66-81593bc322bd tempest-AttachVolumeShelveTestJSON-1193191986 None] Deleting attachment 634f42a8-ad66-4062-a0b7-25f2187609c4. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:40:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:40:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:40:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:40:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:40:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:40:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:40:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:40:53 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:40:53 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:40:54 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:40:54 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Jul 08 10:40:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.855s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:40:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:40:56 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Flow 'volume_create_manager' (32304381-2c7a-4ae8-bd3e-38e4968dbc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459ead64-cd6c-46f6-b809-6df81098a9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459ead64-cd6c-46f6-b809-6df81098a9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-393770083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b04b663-d752-43ae-9d79-8092228f257f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfff8e6064b24bd8ab85652fe8e33950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:40:57Z,use_quota=True,user_id='399a52f9d8df42f38ccdea16635f2dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddcfbb53-9b1d-4143-a604-e966c90602b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddcfbb53-9b1d-4143-a604-e966c90602b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e6a73a-926a-43ff-9be8-8fa181da4e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e6a73a-926a-43ff-9be8-8fa181da4e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b04b663-d752-43ae-9d79-8092228f257f', 'volume_name': 'volume-9b04b663-d752-43ae-9d79-8092228f257f', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ccad9f-597c-4922-8f31-428184dbc19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ccad9f-597c-4922-8f31-428184dbc19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39abaa15-f26b-4ec0-9bfc-99ddb3b88a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:57 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Volume 9b04b663-d752-43ae-9d79-8092228f257f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b04b663-d752-43ae-9d79-8092228f257f', 'volume_size': 1} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-393770083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b04b663-d752-43ae-9d79-8092228f257f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfff8e6064b24bd8ab85652fe8e33950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:40:57Z,use_quota=True,user_id='399a52f9d8df42f38ccdea16635f2dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Creating volume 9b04b663-d752-43ae-9d79-8092228f257f {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:40:57 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:40:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:40:57 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f 1073741824 Jul 08 10:40:57 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:40:58 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Jul 08 10:40:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f 1073741824" returned: 0 in 1.742s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:40:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:40:58 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f Jul 08 10:40:58 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:40:59 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Jul 08 10:40:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f" returned: 0 in 0.825s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:40:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] <== create_volume: return (2631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:40:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.637s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:40:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39abaa15-f26b-4ec0-9bfc-99ddb3b88a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b04b663-d752-43ae-9d79-8092228f257f', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c331820-4d41-4bf6-a01d-54406d0aa8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:40:59 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Volume volume-9b04b663-d752-43ae-9d79-8092228f257f (9b04b663-d752-43ae-9d79-8092228f257f): created successfully Jul 08 10:40:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c331820-4d41-4bf6-a01d-54406d0aa8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:40:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Flow 'volume_create_manager' (32304381-2c7a-4ae8-bd3e-38e4968dbc27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:40:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4c772eef-d32a-47e0-af50-689d28644bab tempest-TaggedAttachmentsTest-752168017 None] Created volume successfully. Jul 08 10:41:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Acquiring lock "cinder-63b51461-d304-4c1d-b804-d4484dbda0cb-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:41:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Lock "cinder-63b51461-d304-4c1d-b804-d4484dbda0cb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:41:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Acquiring lock "cinder-quobyte-63b51461-d304-4c1d-b804-d4484dbda0cb" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:41:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Lock "cinder-quobyte-63b51461-d304-4c1d-b804-d4484dbda0cb" acquired by "delete_volume" :: waited 0.037s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:41:06 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f31be7-4dc0-4ae9-8c23-99a54253265f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:41:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:06 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb Jul 08 10:41:06 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:08 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb" returned: 0 in 2.228s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:08 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb Jul 08 10:41:08 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:09 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-63b51461-d304-4c1d-b804-d4484dbda0cb" returned: 0 in 0.989s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Lock "cinder-quobyte-63b51461-d304-4c1d-b804-d4484dbda0cb" released by "delete_volume" :: held 3.312s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:41:09 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Created reservations ['0576a518-3246-47ed-90fd-b7074fbe8993', 'eaa8f7da-6635-468b-b14d-accfd1f2671e', 'b51defcc-fb7d-4434-8d72-d22a91f76e1c', 'd6c1638f-5865-47cd-9605-48da3efeb504'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:41:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:41:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:41:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:09 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:41:09 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:11 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 2.064s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:11 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:41:12 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Deleted volume successfully. Jul 08 10:41:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2fc7b87f-4893-402f-99ff-c19502bb69fb tempest-ServerRescueNegativeTestJSON-1743132947 None] Lock "cinder-63b51461-d304-4c1d-b804-d4484dbda0cb-delete_volume" released by "delete_volume" :: held 5.965s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:41:19 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=5,cinder:UPDATE=11,cinder:INSERT=3 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:41:22 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:41:44 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:41:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Flow 'volume_create_manager' (704ba5ac-33ec-427c-a91a-e12418f50ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:41:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9723250-b0d0-4aff-b881-17133e12ea38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9723250-b0d0-4aff-b881-17133e12ea38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1191802306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bacabe1-f42e-4296-8e3e-87794aec591a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c798e0267bb5411f95dd96a57eca23fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:41:45Z,use_quota=True,user_id='ba68cfafbb7f4f4b86e76a9230095ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9a60aa-cc10-43f1-9aa5-c7fc0bc21130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9a60aa-cc10-43f1-9aa5-c7fc0bc21130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5f63fe-7980-4a8b-a874-8a783e4b1170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5f63fe-7980-4a8b-a874-8a783e4b1170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bacabe1-f42e-4296-8e3e-87794aec591a', 'volume_name': 'volume-6bacabe1-f42e-4296-8e3e-87794aec591a', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72577f22-5315-4a17-a261-4edbd465ef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72577f22-5315-4a17-a261-4edbd465ef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7c1f8f-7e79-4795-82a0-c19314c2b405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:45 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Volume 6bacabe1-f42e-4296-8e3e-87794aec591a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bacabe1-f42e-4296-8e3e-87794aec591a', 'volume_size': 1} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1191802306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bacabe1-f42e-4296-8e3e-87794aec591a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c798e0267bb5411f95dd96a57eca23fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:41:45Z,use_quota=True,user_id='ba68cfafbb7f4f4b86e76a9230095ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Creating volume 6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:41:45 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:45 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a 1073741824 Jul 08 10:41:45 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Flow 'volume_create_manager' (d8494214-ec11-4cdc-9f50-dec551e87683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af14d7a-2b66-4306-bf37-a9ca55dead01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af14d7a-2b66-4306-bf37-a9ca55dead01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-712302299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d453223f-4051-4d51-9b80-2ea53aa5d05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06a788d9a6d42b0babb49c3420783e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:41:46Z,use_quota=True,user_id='006a27fa89d041e9bfaba2b1cf5f982e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0007051b-11db-418d-a65d-8e6d19f0bdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0007051b-11db-418d-a65d-8e6d19f0bdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ba185a-aa57-47f1-ad5a-3d4e0806bfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ba185a-aa57-47f1-ad5a-3d4e0806bfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd453223f-4051-4d51-9b80-2ea53aa5d05f', 'volume_name': 'volume-d453223f-4051-4d51-9b80-2ea53aa5d05f', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7645b7-32d0-47df-93a8-3ee4325b9fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7645b7-32d0-47df-93a8-3ee4325b9fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fac1d7-8a95-4bc8-83f6-ca5474868539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:45 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Volume d453223f-4051-4d51-9b80-2ea53aa5d05f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d453223f-4051-4d51-9b80-2ea53aa5d05f', 'volume_size': 1} Jul 08 10:41:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:46 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a 1073741824" returned: 0 in 1.069s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:46 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a Jul 08 10:41:46 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:46 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a" returned: 0 in 0.627s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-712302299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d453223f-4051-4d51-9b80-2ea53aa5d05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06a788d9a6d42b0babb49c3420783e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:41:46Z,use_quota=True,user_id='006a27fa89d041e9bfaba2b1cf5f982e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Creating volume d453223f-4051-4d51-9b80-2ea53aa5d05f {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:41:46 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:46 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f 1073741824 Jul 08 10:41:46 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7c1f8f-7e79-4795-82a0-c19314c2b405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bacabe1-f42e-4296-8e3e-87794aec591a', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44975d67-7e0f-4c31-9f5c-bf890305225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:46 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Volume volume-6bacabe1-f42e-4296-8e3e-87794aec591a (6bacabe1-f42e-4296-8e3e-87794aec591a): created successfully Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44975d67-7e0f-4c31-9f5c-bf890305225d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Flow 'volume_create_manager' (704ba5ac-33ec-427c-a91a-e12418f50ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:41:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4f904431-d45b-4d03-ab07-babd086a27b5 tempest-SnapshotsActionsTest-298402846 None] Created volume successfully. Jul 08 10:41:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:47 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f 1073741824" returned: 0 in 0.890s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:47 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f Jul 08 10:41:47 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:48 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f" returned: 0 in 0.705s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.029s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fac1d7-8a95-4bc8-83f6-ca5474868539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d453223f-4051-4d51-9b80-2ea53aa5d05f', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d32797-e647-491d-be80-69ee8415d881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:48 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Volume volume-d453223f-4051-4d51-9b80-2ea53aa5d05f (d453223f-4051-4d51-9b80-2ea53aa5d05f): created successfully Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d32797-e647-491d-be80-69ee8415d881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Flow 'volume_create_manager' (d8494214-ec11-4cdc-9f50-dec551e87683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] Creating offline snapshot 8b6208c1-8f2d-4f1e-a1d5-866002510bc0 of volume 6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:41:48 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1a719a5e-ae28-4d74-94a8-664e1aa7adba tempest-ServersNegativeTestJSON-1180560702 None] Created volume successfully. Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a041859-bee2-4845-be8c-972b30283f1c]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:48 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a Jul 08 10:41:48 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Acquiring lock "cinder-fab1468a-bc9e-4423-8632-6b4b2835692e-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Lock "cinder-fab1468a-bc9e-4423-8632-6b4b2835692e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Acquiring lock "cinder-quobyte-fab1468a-bc9e-4423-8632-6b4b2835692e" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Lock "cinder-quobyte-fab1468a-bc9e-4423-8632-6b4b2835692e" acquired by "delete_volume" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8740b9f8-2258-42ca-90e4-b6d93d3e93e6]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:41:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:48 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e Jul 08 10:41:48 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:49 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a" returned: 0 in 0.814s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:49 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 1G Jul 08 10:41:49 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:49 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e" returned: 0 in 0.795s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:49 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e Jul 08 10:41:49 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:50 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 1G" returned: 0 in 0.889s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:50 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:41:50 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:50 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fab1468a-bc9e-4423-8632-6b4b2835692e" returned: 0 in 0.661s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Lock "cinder-quobyte-fab1468a-bc9e-4423-8632-6b4b2835692e" released by "delete_volume" :: held 1.507s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Flow 'volume_create_manager' (e3bf7051-425e-4121-a2bc-aa9f6b08e38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6766da-f4e9-4d21-9e8b-3b0fa96db107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6766da-f4e9-4d21-9e8b-3b0fa96db107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1514029255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2eca367-5e6a-41f9-8870-bd37dc94e268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06a788d9a6d42b0babb49c3420783e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:41:50Z,use_quota=True,user_id='006a27fa89d041e9bfaba2b1cf5f982e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5622f4e-2b3c-4f85-bc8e-156374c680ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5622f4e-2b3c-4f85-bc8e-156374c680ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c859787-2728-46a6-b857-99c1af40de04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c859787-2728-46a6-b857-99c1af40de04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2eca367-5e6a-41f9-8870-bd37dc94e268', 'volume_name': 'volume-c2eca367-5e6a-41f9-8870-bd37dc94e268', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5f09bf-8cd7-4170-9357-e347517f7373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5f09bf-8cd7-4170-9357-e347517f7373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bf4858-5d33-4681-ae76-5b0d8555639c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:50 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Volume c2eca367-5e6a-41f9-8870-bd37dc94e268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2eca367-5e6a-41f9-8870-bd37dc94e268', 'volume_size': 1} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Created reservations ['538a3e20-9009-48aa-9549-18dca4e21c82', '35746532-e45f-48df-9fe5-1857379fff8a', '545557e0-78c8-4df9-a6dc-de3e623159bb', 'a889fe9e-3962-42d1-93c7-e96e4caa7449'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:50 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:41:50 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:51 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 0.761s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:51 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 is being set with open permissions: ugo+rw Jul 08 10:41:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:51 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:41:51 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:51 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.745s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:51 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:41:51 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Deleted volume successfully. Jul 08 10:41:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c1591ad-417f-41cb-a3ad-79dc4469c7a6 tempest-AttachVolumeShelveTestJSON-1193191986 None] Lock "cinder-fab1468a-bc9e-4423-8632-6b4b2835692e-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:41:51 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 0.706s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:51 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.info Jul 08 10:41:51 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:52 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.info" returned: 0 in 0.809s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:52 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.info is being set with open permissions: ugo+rw Jul 08 10:41:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:52 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.info Jul 08 10:41:52 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:53 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.info" returned: 0 in 0.781s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.961s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.903s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1514029255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2eca367-5e6a-41f9-8870-bd37dc94e268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06a788d9a6d42b0babb49c3420783e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:41:50Z,use_quota=True,user_id='006a27fa89d041e9bfaba2b1cf5f982e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Creating volume c2eca367-5e6a-41f9-8870-bd37dc94e268 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:41:53 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:53 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268 1073741824 Jul 08 10:41:53 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:53 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-599ac3a1-523a-4f3f-8d60-23e28bf3f591 tempest-SnapshotsActionsTest-298402846 None] Create snapshot completed successfully Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:53 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:41:53 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:54 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268 1073741824" returned: 0 in 1.211s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:54 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268 Jul 08 10:41:54 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:54 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.946s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:41:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:41:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 8 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:41:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:41:55 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268" returned: 0 in 0.745s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:41:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.942s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bf4858-5d33-4681-ae76-5b0d8555639c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2eca367-5e6a-41f9-8870-bd37dc94e268', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafaa6d2-fd7b-49f5-9247-f147a9ef41ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:41:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] Creating offline snapshot 36a60bdc-e444-41e0-8fbe-083f7e9660bd of volume 6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:41:55 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Volume volume-c2eca367-5e6a-41f9-8870-bd37dc94e268 (c2eca367-5e6a-41f9-8870-bd37dc94e268): created successfully Jul 08 10:41:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafaa6d2-fd7b-49f5-9247-f147a9ef41ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:41:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Flow 'volume_create_manager' (e3bf7051-425e-4121-a2bc-aa9f6b08e38c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:41:55 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[372bca5a-5104-495a-8a4a-31e94b6184e8]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:41:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:55 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-08d38579-b456-42bf-86b8-aa51f99e0c05 tempest-ServersNegativeTestJSON-1180560702 None] Created volume successfully. Jul 08 10:41:55 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:41:55 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Acquiring lock "cinder-c2eca367-5e6a-41f9-8870-bd37dc94e268-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:41:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Lock "cinder-c2eca367-5e6a-41f9-8870-bd37dc94e268-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:41:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Acquiring lock "cinder-quobyte-c2eca367-5e6a-41f9-8870-bd37dc94e268" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:41:56 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 0.989s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:41:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Lock "cinder-quobyte-c2eca367-5e6a-41f9-8870-bd37dc94e268" acquired by "delete_volume" :: waited 0.038s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:41:56 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd 1G Jul 08 10:41:56 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:56 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe5c4e4-382b-4693-83a4-cddbd63c2174]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:41:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:56 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268 Jul 08 10:41:56 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:57 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268" returned: 0 in 0.882s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:57 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268 Jul 08 10:41:57 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:57 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd 1G" returned: 0 in 1.028s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:57 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd Jul 08 10:41:57 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:58 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c2eca367-5e6a-41f9-8870-bd37dc94e268" returned: 0 in 0.885s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Lock "cinder-quobyte-c2eca367-5e6a-41f9-8870-bd37dc94e268" released by "delete_volume" :: held 1.827s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:41:58 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd" returned: 0 in 0.871s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:58 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd is being set with open permissions: ugo+rw Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:58 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd Jul 08 10:41:58 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Created reservations ['0be10721-f4d2-4922-b90a-b834b166eca2', 'fa59077e-cb24-4225-86a1-4f88ea2d6f3b', 'ceafb1e1-e96e-4a3a-baec-14ac8e546b46', '193efe24-f087-4a82-8493-be599902bdac'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:58 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:41:58 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Acquiring lock "cinder-d453223f-4051-4d51-9b80-2ea53aa5d05f-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Lock "cinder-d453223f-4051-4d51-9b80-2ea53aa5d05f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Acquiring lock "cinder-quobyte-d453223f-4051-4d51-9b80-2ea53aa5d05f" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Lock "cinder-quobyte-d453223f-4051-4d51-9b80-2ea53aa5d05f" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[41564bdb-aefc-47db-92ef-5dff8bfcb735]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:41:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:41:59 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f Jul 08 10:41:59 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:41:59 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.801s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:59 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:41:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Deleted volume successfully. Jul 08 10:41:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-89e62ff5-27e6-4337-ba55-b2922c3122fe tempest-ServersNegativeTestJSON-1180560702 None] Lock "cinder-c2eca367-5e6a-41f9-8870-bd37dc94e268-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:41:59 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd" returned: 0 in 1.119s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.222s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:41:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b5c352cf-aaa1-4294-b3cc-83ae3d8b57e4 tempest-SnapshotsActionsTest-298402846 None] Create snapshot completed successfully Jul 08 10:41:59 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Jul 08 10:41:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f" returned: 0 in 1.078s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:41:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:00 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f Jul 08 10:42:00 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:00 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d453223f-4051-4d51-9b80-2ea53aa5d05f" returned: 0 in 0.663s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Lock "cinder-quobyte-d453223f-4051-4d51-9b80-2ea53aa5d05f" released by "delete_volume" :: held 1.821s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Created reservations ['47e81b12-4adb-4481-814e-9efeb0ec5d05', '0e075bae-8a28-451c-853e-ddb595068f1e', '85a0f3ee-ec96-4ecc-972e-1b2c90736098', '83114aac-0cc0-48be-8641-eb45bd6847b6'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:00 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:42:00 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-36a60bdc-e444-41e0-8fbe-083f7e9660bd-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-36a60bdc-e444-41e0-8fbe-083f7e9660bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-quobyte-36a60bdc-e444-41e0-8fbe-083f7e9660bd" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-36a60bdc-e444-41e0-8fbe-083f7e9660bd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Deleting offline snapshot 36a60bdc-e444-41e0-8fbe-083f7e9660bd of volume 6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] snapshot_file for this snap is: volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1dd0f0da-6424-4802-a34f-6986a4ee0615 tempest-BackendsCapabilitiesAdminTestsJSON-1555895425 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7446327209473, 'free_capacity_gb': 1775.7446327209473, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86913) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b2640f-8625-4951-9530-3637454fed12]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:01 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd Jul 08 10:42:01 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e802db62-b0bf-42f5-9e43-3984f414d131 tempest-BackendsCapabilitiesAdminTestsJSON-1555895425 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7446327209473, 'free_capacity_gb': 1775.7446327209473, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86913) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 10:42:01 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.816s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:01 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:42:01 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Deleted volume successfully. Jul 08 10:42:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3910a119-7d8e-4cfe-8601-a35c1341e1aa tempest-ServersNegativeTestJSON-1180560702 None] Lock "cinder-d453223f-4051-4d51-9b80-2ea53aa5d05f-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:01 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd" returned: 0 in 0.838s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:01 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8d315e-0ad8-48e0-9392-8d1b55684f13]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:01 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:42:01 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:02 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 0.853s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:02 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd Jul 08 10:42:02 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:03 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd" returned: 0 in 1.124s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:03 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd Jul 08 10:42:03 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:04 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.36a60bdc-e444-41e0-8fbe-083f7e9660bd" returned: 0 in 0.977s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-36a60bdc-e444-41e0-8fbe-083f7e9660bd" released by "_delete_snapshot" :: held 3.932s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" released by "delete_snapshot" :: held 3.967s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:04 devstack cinder-volume[86913]: WARNING cinder.quota [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:42:04 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Created reservations ['631de5fd-5dd4-4e93-832a-b100235426f1', 'ce0790dd-d96f-4b19-bc67-ad8bd2906f6f', '55b83ec6-7b43-4d6e-8931-fefe6dfe9643', '976aafb5-cf53-4cf4-8107-ecaa695ebc9a'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Delete snapshot completed successfully. Jul 08 10:42:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cf58b489-2b86-4a4f-92b3-60145e8cf19b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-36a60bdc-e444-41e0-8fbe-083f7e9660bd-delete_snapshot" released by "delete_snapshot" :: held 4.201s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] Creating offline snapshot 2e3bfce1-578e-47d3-8a48-3582f66578c1 of volume 6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:42:05 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4001e83a-59d6-489a-85f8-e77608b84fc3]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:05 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:42:05 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:06 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 0.824s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:06 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 1G Jul 08 10:42:06 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:07 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 1G" returned: 0 in 0.940s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:07 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 Jul 08 10:42:07 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:08 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1" returned: 0 in 0.734s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:08 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 is being set with open permissions: ugo+rw Jul 08 10:42:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:08 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 Jul 08 10:42:08 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:08 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1" returned: 0 in 0.666s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.299s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:08 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1c2ce3d3-408e-41bd-b177-c6c9aeadd7cb tempest-SnapshotsActionsTest-298402846 None] Create snapshot completed successfully Jul 08 10:42:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6c784a01-f7c4-4ccf-b187-41931047740a tempest-GroupSnapshotsTest-1715497858 None] Group tempest-GroupSnapshotsTest-Group-485237086: creating Jul 08 10:42:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6c784a01-f7c4-4ccf-b187-41931047740a tempest-GroupSnapshotsTest-1715497858 None] Group tempest-GroupSnapshotsTest-Group-485237086: created successfully Jul 08 10:42:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6c784a01-f7c4-4ccf-b187-41931047740a tempest-GroupSnapshotsTest-1715497858 None] Create group completed successfully. Jul 08 10:42:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-2e3bfce1-578e-47d3-8a48-3582f66578c1-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-2e3bfce1-578e-47d3-8a48-3582f66578c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-quobyte-2e3bfce1-578e-47d3-8a48-3582f66578c1" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-2e3bfce1-578e-47d3-8a48-3582f66578c1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Deleting offline snapshot 2e3bfce1-578e-47d3-8a48-3582f66578c1 of volume 6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:42:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] snapshot_file for this snap is: volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:42:10 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[65961732-8a4b-4113-bcd0-510cacc80fd3]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:10 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 Jul 08 10:42:10 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:10 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Flow 'volume_create_manager' (702acc7c-2344-47a5-852a-e6938189d4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da8821b-fff1-48fa-86dc-ae665bdb2c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da8821b-fff1-48fa-86dc-ae665bdb2c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-252638941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39052523-7404-4bb5-ae6e-a95dc9b3c6df,host='devstack@QuobyteHD#QuobyteHD',id=b31baf5f-d677-48d4-a006-9a83dd3c27c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68699462087466f9356cda2355530c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:42:11Z,use_quota=True,user_id='cd5d028673e242b5bb7fde0048f1b4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b13d1eed-59a4-47e6-b13d-077ba7171698),volume_type_id=b13d1eed-59a4-47e6-b13d-077ba7171698)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0a752a-df0b-4f1c-8f4e-adf6f7e341ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0a752a-df0b-4f1c-8f4e-adf6f7e341ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8162ffb-bdba-4e6f-b181-854f337ec546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8162ffb-bdba-4e6f-b181-854f337ec546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31baf5f-d677-48d4-a006-9a83dd3c27c6', 'volume_name': 'volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83e7b7e-1615-480b-ada3-ee36e693ddba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83e7b7e-1615-480b-ada3-ee36e693ddba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13af261b-1f62-4502-9e79-6e9f290ce4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:11 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Volume b31baf5f-d677-48d4-a006-9a83dd3c27c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6', 'volume_size': 1} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=39052523-7404-4bb5-ae6e-a95dc9b3c6df,created_at=2026-07-08T08:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-252638941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39052523-7404-4bb5-ae6e-a95dc9b3c6df,host='devstack@QuobyteHD#QuobyteHD',id=b31baf5f-d677-48d4-a006-9a83dd3c27c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68699462087466f9356cda2355530c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:42:11Z,use_quota=True,user_id='cd5d028673e242b5bb7fde0048f1b4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b13d1eed-59a4-47e6-b13d-077ba7171698),volume_type_id=b13d1eed-59a4-47e6-b13d-077ba7171698)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Creating volume b31baf5f-d677-48d4-a006-9a83dd3c27c6 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:42:11 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:11 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 1073741824 Jul 08 10:42:11 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:11 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1" returned: 0 in 1.161s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-2444d17a-db10-4bb4-82ed-3dfb1d2ce77c req-889d25e4-dbbd-45a1-853a-ffb438c76180 tempest-TaggedAttachmentsTest-752168017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[040b58f1-4feb-41d6-99dd-63aaa8996ce3]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:11 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:42:11 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:12 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 1073741824" returned: 0 in 1.066s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:12 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 0.971s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:12 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 Jul 08 10:42:12 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:12 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 Jul 08 10:42:12 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:13 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6" returned: 0 in 0.747s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-2444d17a-db10-4bb4-82ed-3dfb1d2ce77c req-889d25e4-dbbd-45a1-853a-ffb438c76180 tempest-TaggedAttachmentsTest-752168017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.755s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9e5a1-3792-416e-be66-0f2fdceabb79]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-2444d17a-db10-4bb4-82ed-3dfb1d2ce77c req-889d25e4-dbbd-45a1-853a-ffb438c76180 tempest-TaggedAttachmentsTest-752168017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13af261b-1f62-4502-9e79-6e9f290ce4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15425f56-914b-44ee-ae6d-951466364d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:13 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Volume volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 (b31baf5f-d677-48d4-a006-9a83dd3c27c6): created successfully Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15425f56-914b-44ee-ae6d-951466364d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Flow 'volume_create_manager' (702acc7c-2344-47a5-852a-e6938189d4f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:42:13 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-51e4bc80-8034-446b-ad79-d473e11459fb tempest-GroupSnapshotsTest-1715497858 None] Created volume successfully. Jul 08 10:42:13 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f Jul 08 10:42:13 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:13 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1" returned: 0 in 1.008s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:13 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1 Jul 08 10:42:13 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:13 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] GroupSnapshot d98ea471-8392-4592-b65e-dadd1321a41e: creating. Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] Group snapshot d98ea471-8392-4592-b65e-dadd1321a41e: creating. {{(pid=86913) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 10:42:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:14 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-2444d17a-db10-4bb4-82ed-3dfb1d2ce77c req-889d25e4-dbbd-45a1-853a-ffb438c76180 tempest-TaggedAttachmentsTest-752168017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f" returned: 0 in 0.978s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-2444d17a-db10-4bb4-82ed-3dfb1d2ce77c req-889d25e4-dbbd-45a1-853a-ffb438c76180 tempest-TaggedAttachmentsTest-752168017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.099s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] Creating offline snapshot ea57ef98-699d-4264-baa9-dbcc0b1891be of volume b31baf5f-d677-48d4-a006-9a83dd3c27c6 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:42:14 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.2e3bfce1-578e-47d3-8a48-3582f66578c1" returned: 0 in 0.805s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c616db6-0c8f-47ad-a704-a9ecf7fa7b4d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-2e3bfce1-578e-47d3-8a48-3582f66578c1" released by "_delete_snapshot" :: held 4.084s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-2444d17a-db10-4bb4-82ed-3dfb1d2ce77c req-889d25e4-dbbd-45a1-853a-ffb438c76180 tempest-TaggedAttachmentsTest-752168017 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-9b04b663-d752-43ae-9d79-8092228f257f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ac9cad4-566e-45e6-a362-de83eb487f2f', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" released by "delete_snapshot" :: held 4.123s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:14 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-2444d17a-db10-4bb4-82ed-3dfb1d2ce77c req-889d25e4-dbbd-45a1-853a-ffb438c76180 tempest-TaggedAttachmentsTest-752168017 None] attachment_update completed successfully. Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Created reservations ['54b03e18-aa04-4cf1-9f7a-4df663b3f226', '1af2ff7c-c52c-4098-a21f-08b3ee8436ec', 'ae8dea58-3007-4523-9c11-d322d773e984', '84a93fa9-0301-45db-82ea-03d6aaf55383'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:14 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 Jul 08 10:42:14 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:14 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Delete snapshot completed successfully. Jul 08 10:42:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8917b0ce-c97b-44a5-8594-70eb32dd005b tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-2e3bfce1-578e-47d3-8a48-3582f66578c1-delete_snapshot" released by "delete_snapshot" :: held 4.373s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:15 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6" returned: 0 in 0.974s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:15 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be 1G Jul 08 10:42:15 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:16 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be 1G" returned: 0 in 1.018s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:16 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be Jul 08 10:42:16 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:16 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be" returned: 0 in 0.761s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:16 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:42:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:16 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be Jul 08 10:42:16 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:17 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be" returned: 0 in 0.811s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:17 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.info Jul 08 10:42:17 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:18 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.info" returned: 0 in 0.767s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:18 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:42:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:18 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.info Jul 08 10:42:18 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:19 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.info" returned: 0 in 0.788s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.235s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.637s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] Creating offline snapshot 383e01ab-15b2-4538-abed-6a94d2c39863 of volume 6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:42:19 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd0cf5e-0db3-4043-a35b-3c5900033408]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:19 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e5ea99bf-4917-4f95-b8ba-d2ee7bb889c6 tempest-GroupSnapshotsTest-1715497858 None] group_snapshot d98ea471-8392-4592-b65e-dadd1321a41e: created successfully Jul 08 10:42:19 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:42:19 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:20 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 0.935s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:20 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 1G Jul 08 10:42:20 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-3427844f-2cc2-4898-92ec-51a0ebae4fd7 req-4683eefa-755c-48ed-a588-02e7ef8a69c6 tempest-TaggedAttachmentsTest-752168017 None] Terminate volume connection completed successfully. Jul 08 10:42:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-3427844f-2cc2-4898-92ec-51a0ebae4fd7 req-4683eefa-755c-48ed-a588-02e7ef8a69c6 tempest-TaggedAttachmentsTest-752168017 None] Deleting attachment 7ac9cad4-566e-45e6-a362-de83eb487f2f. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:42:21 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 1G" returned: 0 in 1.208s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:21 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 Jul 08 10:42:21 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:22 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863" returned: 0 in 1.157s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:22 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 is being set with open permissions: ugo+rw Jul 08 10:42:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:22 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 Jul 08 10:42:22 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:23 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863" returned: 0 in 0.851s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.336s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.950s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-ea57ef98-699d-4264-baa9-dbcc0b1891be-77a0fb03-afa7-4901-a464-cb4f2864eada" by "_create_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-ea57ef98-699d-4264-baa9-dbcc0b1891be-77a0fb03-afa7-4901-a464-cb4f2864eada" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Creating volume 77a0fb03-afa7-4901-a464-cb4f2864eada from snapshot ea57ef98-699d-4264-baa9-dbcc0b1891be {{(pid=86913) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-77a0fb03-afa7-4901-a464-cb4f2864eada" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-77a0fb03-afa7-4901-a464-cb4f2864eada" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] snapshot: ea57ef98-699d-4264-baa9-dbcc0b1891be, volume: 77a0fb03-afa7-4901-a464-cb4f2864eada, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 10:42:23 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-881ae34f-f907-4d28-bde9-c8a667390a15 tempest-SnapshotsActionsTest-298402846 None] Create snapshot completed successfully Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4406be-6cc7-4a36-a233-191da28ac1ba]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:24 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be Jul 08 10:42:24 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-383e01ab-15b2-4538-abed-6a94d2c39863-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-383e01ab-15b2-4538-abed-6a94d2c39863-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-quobyte-383e01ab-15b2-4538-abed-6a94d2c39863" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-383e01ab-15b2-4538-abed-6a94d2c39863" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Deleting offline snapshot 383e01ab-15b2-4538-abed-6a94d2c39863 of volume 6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:42:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] snapshot_file for this snap is: volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:42:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ce6956-54ea-42f8-bad0-def3cd6608b5]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:25 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be" returned: 0 in 1.163s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 10:42:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 10:42:25 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97c361e-2c47-4d7c-b256-60c50c57d077]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:25 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 Jul 08 10:42:25 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:25 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 Jul 08 10:42:25 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:26 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863" returned: 0 in 1.089s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:26 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c949a3-88eb-4ea4-a48e-bb94e9a797ce]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:26 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6" returned: 0 in 1.081s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:26 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 10:42:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:26 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada Jul 08 10:42:26 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:42:26 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:26 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:26 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 0.860s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:26 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 Jul 08 10:42:26 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863" returned: 0 in 2.403s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:29 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:29 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863 Jul 08 10:42:29 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:30 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.383e01ab-15b2-4538-abed-6a94d2c39863" returned: 0 in 1.473s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-383e01ab-15b2-4538-abed-6a94d2c39863" released by "_delete_snapshot" :: held 5.973s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" released by "delete_snapshot" :: held 6.003s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:31 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Created reservations ['3ba2e901-6715-4980-82b9-829fd6289a57', '8c5f90f6-6cc9-48aa-b8cc-ab2a6e60384a', 'cc15da5d-17e2-4ed2-843e-6e11c96cb777', '849189e7-2624-4d8b-901a-eeec17fe5427'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:31 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Delete snapshot completed successfully. Jul 08 10:42:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-331d139a-b4d7-432b-ba69-e88e49a9dd25 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-383e01ab-15b2-4538-abed-6a94d2c39863-delete_snapshot" released by "delete_snapshot" :: held 6.277s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:33 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada" returned: 0 in 7.103s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:33 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[61471090-ebde-45bb-a658-6d1e5ef87d44]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:33 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 Jul 08 10:42:33 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:34 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6" returned: 0 in 1.034s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:34 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6, size 1024.00 MB, duration 7.10 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:42:34 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Converted 1024.00 MB image at 144.15 MB/s Jul 08 10:42:34 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:42:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:34 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada Jul 08 10:42:34 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:35 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada" returned: 0 in 0.811s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-77a0fb03-afa7-4901-a464-cb4f2864eada" released by "_copy_volume_from_snapshot" :: held 11.410s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-ea57ef98-699d-4264-baa9-dbcc0b1891be-77a0fb03-afa7-4901-a464-cb4f2864eada" released by "_create_volume_from_snapshot" :: held 11.488s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.532s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.071s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] Creating offline snapshot 06dd015e-de91-449e-b273-804e58458f25 of volume 6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:42:35 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbed4c9a-be95-41c5-b939-172f32f3da51]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:35 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-42316f73-a000-4892-828f-055b232e8944 tempest-GroupSnapshotsTest-1715497858 None] Create group from source-snapshot-d98ea471-8392-4592-b65e-dadd1321a41e completed successfully. Jul 08 10:42:35 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:42:35 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-77a0fb03-afa7-4901-a464-cb4f2864eada" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-77a0fb03-afa7-4901-a464-cb4f2864eada" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:36 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[9723e9a7-eb2d-4a2a-84e7-820962590225]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:36 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 1.254s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:36 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 1G Jul 08 10:42:36 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:36 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada Jul 08 10:42:36 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:37 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada" returned: 0 in 1.029s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:37 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada Jul 08 10:42:37 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:37 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 1G" returned: 0 in 1.166s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:37 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 Jul 08 10:42:37 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:38 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-77a0fb03-afa7-4901-a464-cb4f2864eada" returned: 0 in 0.819s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-77a0fb03-afa7-4901-a464-cb4f2864eada" released by "delete_volume" :: held 1.939s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['0eed479c-7d01-4a2d-88de-0193c7f6c5be'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:38 devstack cinder-volume[86913]: WARNING cinder.quota [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1425353972 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1425353972, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:42:38 devstack cinder-volume[86913]: WARNING cinder.quota [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1425353972 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1425353972, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['933b84ef-20f3-4f3a-ad5b-89f7555a5aec', 'c8405e73-b4e2-4bfd-9b68-028933e68622', 'd56c20ee-ee26-44ac-b439-1b49d6dc75e5', 'dc4c1a24-0a8e-4db5-b89d-8c7a80dae021'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:38 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25" returned: 0 in 0.883s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:38 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 is being set with open permissions: ugo+rw Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:38 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 Jul 08 10:42:38 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:38 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:42:38 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] group_snapshot d98ea471-8392-4592-b65e-dadd1321a41e: deleting Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] group_snapshot d98ea471-8392-4592-b65e-dadd1321a41e: deleting {{(pid=86913) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-b31baf5f-d677-48d4-a006-9a83dd3c27c6" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-b31baf5f-d677-48d4-a006-9a83dd3c27c6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-ea57ef98-699d-4264-baa9-dbcc0b1891be" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-ea57ef98-699d-4264-baa9-dbcc0b1891be" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Deleting offline snapshot ea57ef98-699d-4264-baa9-dbcc0b1891be of volume b31baf5f-d677-48d4-a006-9a83dd3c27c6 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] snapshot_file for this snap is: volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ee7303-7c99-4e17-9070-1e9c16cc3d6f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:39 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be Jul 08 10:42:39 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:39 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25" returned: 0 in 0.797s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:39 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.275s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.822s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:39 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:42:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-401d6a35-6d9d-4160-9abe-83c656775281 tempest-GroupSnapshotsTest-1715497858 None] Delete group completed successfully. Jul 08 10:42:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e305c33c-c6f3-4062-9c04-5fbbc2b0118c tempest-SnapshotsActionsTest-298402846 None] Create snapshot completed successfully Jul 08 10:42:40 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be" returned: 0 in 0.929s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0bbbaf-bac9-4aeb-87c1-466c7e27014f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:40 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 Jul 08 10:42:40 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-06dd015e-de91-449e-b273-804e58458f25-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-06dd015e-de91-449e-b273-804e58458f25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Acquiring lock "cinder-quobyte-06dd015e-de91-449e-b273-804e58458f25" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-06dd015e-de91-449e-b273-804e58458f25" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Deleting offline snapshot 06dd015e-de91-449e-b273-804e58458f25 of volume 6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] snapshot_file for this snap is: volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2652cd-cba3-45b7-bd5d-374161e61af1]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:40 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 Jul 08 10:42:40 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:41 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6" returned: 0 in 0.866s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:41 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be Jul 08 10:42:41 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:41 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25" returned: 0 in 0.970s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:41 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f05827-b82e-4738-bcee-256d76dd59a3]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:41 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:42:41 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:41 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be" returned: 0 in 0.941s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:42 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be Jul 08 10:42:42 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:42 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 1.045s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:42 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 Jul 08 10:42:42 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:42 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6.ea57ef98-699d-4264-baa9-dbcc0b1891be" returned: 0 in 0.920s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-ea57ef98-699d-4264-baa9-dbcc0b1891be" released by "_delete_snapshot" :: held 3.782s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-b31baf5f-d677-48d4-a006-9a83dd3c27c6" released by "delete_snapshot" :: held 3.831s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:42 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=76,cinder:SELECT=84,cinder:DELETE=7,cinder:INSERT=17 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:42:43 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=75,cinder:UPDATE=76,cinder:INSERT=18,cinder:DELETE=5 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:42:43 devstack cinder-volume[86913]: WARNING cinder.quota [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1425353972 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1425353972, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:42:43 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['0ea706bd-e935-45a8-905e-1ec53df5a406', 'd1daa887-a054-4b92-a7e5-4a06c7305c2d', 'a67e586e-2da2-4f5c-afd3-80cd09a1cb40', 'd4ddb010-1302-4a8b-9a08-1564fdd2e3aa'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:43 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c542b963-26bb-4479-a104-b6f09c890513 tempest-GroupSnapshotsTest-1715497858 None] group_snapshot d98ea471-8392-4592-b65e-dadd1321a41e: deleted successfully Jul 08 10:42:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Acquiring lock "cinder-9b04b663-d752-43ae-9d79-8092228f257f-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Lock "cinder-9b04b663-d752-43ae-9d79-8092228f257f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Acquiring lock "cinder-quobyte-9b04b663-d752-43ae-9d79-8092228f257f" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Lock "cinder-quobyte-9b04b663-d752-43ae-9d79-8092228f257f" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:43 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d87f7e0-29fb-46fd-8131-29cf1ac9c263]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:43 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f Jul 08 10:42:43 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:44 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25" returned: 0 in 1.296s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:44 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25 Jul 08 10:42:44 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-b31baf5f-d677-48d4-a006-9a83dd3c27c6" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-b31baf5f-d677-48d4-a006-9a83dd3c27c6" acquired by "delete_volume" :: waited 0.045s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:44 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f79244-8dcc-4728-8937-b0525ae8bbee]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:44 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 Jul 08 10:42:44 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:44 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f" returned: 0 in 1.264s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:44 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f Jul 08 10:42:44 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:45 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.06dd015e-de91-449e-b273-804e58458f25" returned: 0 in 1.200s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-06dd015e-de91-449e-b273-804e58458f25" released by "_delete_snapshot" :: held 4.665s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" released by "delete_snapshot" :: held 4.694s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:45 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Created reservations ['3009aece-0938-4ea2-b04c-41ff8b5a6569', 'c2fa3bee-2444-4029-bcbe-d2c32c00fed2', 'ecf49b05-c119-45de-8bc6-23cca1dde372', '1c461cd8-0497-4ca4-b0eb-ebddfcdebbe5'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6" returned: 0 in 1.213s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:45 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6 Jul 08 10:42:45 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:45 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Delete snapshot completed successfully. Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f3a2d7e7-7fe9-4c00-b623-b41243af2842 tempest-SnapshotsActionsTest-538082272 None] Lock "cinder-06dd015e-de91-449e-b273-804e58458f25-delete_snapshot" released by "delete_snapshot" :: held 5.030s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:45 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9b04b663-d752-43ae-9d79-8092228f257f" returned: 0 in 0.968s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Lock "cinder-quobyte-9b04b663-d752-43ae-9d79-8092228f257f" released by "delete_volume" :: held 2.298s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Created reservations ['b7566211-4872-4404-a29d-b6227d59a2a8', 'f2486bcd-2554-4960-b4b4-08eded54ba31', 'edf149a1-c8c6-48e6-b0c5-5e80be1effaa', '197c3f0d-8276-4785-a914-5d38029f7c93'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:46 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:42:46 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:46 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b31baf5f-d677-48d4-a006-9a83dd3c27c6" returned: 0 in 0.763s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-b31baf5f-d677-48d4-a006-9a83dd3c27c6" released by "delete_volume" :: held 2.104s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['135c82af-648c-436c-b70c-2b36d5d71feb'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "cinder-8b6208c1-8f2d-4f1e-a1d5-866002510bc0-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:46 devstack cinder-volume[86913]: WARNING cinder.db.api [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1425353972'] Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['57f0ddab-3e50-4814-bea1-b2150bc19af3', '2f22550f-7f83-4635-bc74-e4a796a9feb8', 'c9766be0-afba-40f6-9dd6-3c95cc996c87', 'a9f0d68d-2f48-4416-af15-7280cb1bb74d'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Lock "cinder-8b6208c1-8f2d-4f1e-a1d5-866002510bc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "cinder-quobyte-8b6208c1-8f2d-4f1e-a1d5-866002510bc0" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Lock "cinder-quobyte-8b6208c1-8f2d-4f1e-a1d5-866002510bc0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Deleting offline snapshot 8b6208c1-8f2d-4f1e-a1d5-866002510bc0 of volume 6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] snapshot_file for this snap is: volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[427a42a9-a667-45a4-8714-ddcef9d91291]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:46 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:42:46 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:46 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:42:46 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:47 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.070s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:47 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:42:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Deleted volume successfully. Jul 08 10:42:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5f6936c6-1020-4a3b-b7bd-14498d182311 tempest-TaggedAttachmentsTest-752168017 None] Lock "cinder-9b04b663-d752-43ae-9d79-8092228f257f-delete_volume" released by "delete_volume" :: held 3.649s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-aaa09241-1a0b-49c6-aed3-c14147cbcb5b tempest-GroupSnapshotsTest-1715497858 None] Group tempest-GroupSnapshotsTest-Group-1395980933: creating Jul 08 10:42:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-aaa09241-1a0b-49c6-aed3-c14147cbcb5b tempest-GroupSnapshotsTest-1715497858 None] Group tempest-GroupSnapshotsTest-Group-1395980933: created successfully Jul 08 10:42:47 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.893s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:47 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:42:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-aaa09241-1a0b-49c6-aed3-c14147cbcb5b tempest-GroupSnapshotsTest-1715497858 None] Create group completed successfully. Jul 08 10:42:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0a39eadc-c053-4ff1-971c-90a6c8be2921 tempest-GroupSnapshotsTest-1715497858 None] Delete group completed successfully. Jul 08 10:42:47 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 1.143s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bacabe1-f42e-4296-8e3e-87794aec591a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:42:47 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc478f03-a9ea-4b85-9f96-189e02371f07]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:47 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a Jul 08 10:42:47 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:48 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a" returned: 0 in 0.902s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:48 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:42:48 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Flow 'volume_create_manager' (b5397a28-4c88-4602-b7d6-8c22c36ab504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea504e3-17c4-450c-a0fa-dd5dd41958b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea504e3-17c4-450c-a0fa-dd5dd41958b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1049306147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1a740f5-7bdb-4d99-9ebb-5f09a24ce847,host='devstack@QuobyteHD#QuobyteHD',id=2c312bae-b324-4ab4-8708-68ff9b1c6df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68699462087466f9356cda2355530c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:42:50Z,use_quota=True,user_id='cd5d028673e242b5bb7fde0048f1b4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9e7a7da-fde9-4a56-8c88-8166f2a32950),volume_type_id=d9e7a7da-fde9-4a56-8c88-8166f2a32950)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6296121-598e-4218-91be-3fb4f2f496a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6296121-598e-4218-91be-3fb4f2f496a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1592d9fe-5369-4da9-95a5-97d8f9efeba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1592d9fe-5369-4da9-95a5-97d8f9efeba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c312bae-b324-4ab4-8708-68ff9b1c6df6', 'volume_name': 'volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f821a12a-495a-4f1d-902c-3f6991331968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f821a12a-495a-4f1d-902c-3f6991331968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0b4d6b-56ed-42a4-8a1d-7dea5778cccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:49 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Volume 2c312bae-b324-4ab4-8708-68ff9b1c6df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6', 'volume_size': 1} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1a740f5-7bdb-4d99-9ebb-5f09a24ce847,created_at=2026-07-08T08:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1049306147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1a740f5-7bdb-4d99-9ebb-5f09a24ce847,host='devstack@QuobyteHD#QuobyteHD',id=2c312bae-b324-4ab4-8708-68ff9b1c6df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68699462087466f9356cda2355530c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:42:50Z,use_quota=True,user_id='cd5d028673e242b5bb7fde0048f1b4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9e7a7da-fde9-4a56-8c88-8166f2a32950),volume_type_id=d9e7a7da-fde9-4a56-8c88-8166f2a32950)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Creating volume 2c312bae-b324-4ab4-8708-68ff9b1c6df6 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:42:49 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:42:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:49 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 1073741824 Jul 08 10:42:49 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:50 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 1.325s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:50 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0 Jul 08 10:42:50 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:50 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 1073741824" returned: 0 in 1.033s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:50 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a.8b6208c1-8f2d-4f1e-a1d5-866002510bc0" returned: 0 in 0.980s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:51 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 Jul 08 10:42:51 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Lock "cinder-quobyte-8b6208c1-8f2d-4f1e-a1d5-866002510bc0" released by "_delete_snapshot" :: held 4.544s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" released by "delete_snapshot" :: held 4.613s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:51 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Created reservations ['691d8008-f4b3-4c4e-8abd-4100bd05602c', 'ae839396-d04a-4ff2-8b44-86122ed6b56e', '7a391943-7861-4f8a-ad21-b1013f0cbf5d', '82642271-0371-486d-8710-57d6016baad3'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:51 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Delete snapshot completed successfully. Jul 08 10:42:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9bce5809-a4d3-45d6-ac82-0ff57c3c4342 tempest-SnapshotsActionsTest-298402846 None] Lock "cinder-8b6208c1-8f2d-4f1e-a1d5-866002510bc0-delete_snapshot" released by "delete_snapshot" :: held 4.956s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:51 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6" returned: 0 in 0.905s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:42:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0b4d6b-56ed-42a4-8a1d-7dea5778cccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd4cd4e-e815-4900-92ed-8eac76e9b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:52 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Volume volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 (2c312bae-b324-4ab4-8708-68ff9b1c6df6): created successfully Jul 08 10:42:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd4cd4e-e815-4900-92ed-8eac76e9b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Flow 'volume_create_manager' (b5397a28-4c88-4602-b7d6-8c22c36ab504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:42:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "cinder-6bacabe1-f42e-4296-8e3e-87794aec591a-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:52 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2ddd43e3-6174-4df7-af8d-a6c8b78d1a38 tempest-GroupSnapshotsTest-1715497858 None] Created volume successfully. Jul 08 10:42:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Lock "cinder-6bacabe1-f42e-4296-8e3e-87794aec591a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:42:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:42:52 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f4f94d-8720-43fb-9c1c-46857cbaa308]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:42:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:52 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a Jul 08 10:42:52 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Flow 'volume_create_manager' (3719a29a-e4af-4f15-b913-f2719efa1f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709a91d5-fe25-458f-bba9-09b65489d935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709a91d5-fe25-458f-bba9-09b65489d935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-526905760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1a740f5-7bdb-4d99-9ebb-5f09a24ce847,host='devstack@QuobyteHD#QuobyteHD',id=4dcd3ef2-0c1f-4608-93de-e877ee9687b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68699462087466f9356cda2355530c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:42:53Z,use_quota=True,user_id='cd5d028673e242b5bb7fde0048f1b4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9e7a7da-fde9-4a56-8c88-8166f2a32950),volume_type_id=d9e7a7da-fde9-4a56-8c88-8166f2a32950)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec83fd88-7bb9-4f31-be52-6661b642a1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec83fd88-7bb9-4f31-be52-6661b642a1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323e9a84-89dd-4302-9d39-14294f7068ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323e9a84-89dd-4302-9d39-14294f7068ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dcd3ef2-0c1f-4608-93de-e877ee9687b6', 'volume_name': 'volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66553c5-2795-4e3f-8c7e-e48fdfcb8a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66553c5-2795-4e3f-8c7e-e48fdfcb8a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a7f068-4cc1-48e8-96ef-c8aab4a15801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:53 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Volume 4dcd3ef2-0c1f-4608-93de-e877ee9687b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6', 'volume_size': 1} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1a740f5-7bdb-4d99-9ebb-5f09a24ce847,created_at=2026-07-08T08:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-526905760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1a740f5-7bdb-4d99-9ebb-5f09a24ce847,host='devstack@QuobyteHD#QuobyteHD',id=4dcd3ef2-0c1f-4608-93de-e877ee9687b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68699462087466f9356cda2355530c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:42:53Z,use_quota=True,user_id='cd5d028673e242b5bb7fde0048f1b4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9e7a7da-fde9-4a56-8c88-8166f2a32950),volume_type_id=d9e7a7da-fde9-4a56-8c88-8166f2a32950)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Creating volume 4dcd3ef2-0c1f-4608-93de-e877ee9687b6 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:42:53 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:53 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 1073741824 Jul 08 10:42:53 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:53 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a" returned: 0 in 1.575s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:53 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a Jul 08 10:42:53 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:54 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:42:54 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:55 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6bacabe1-f42e-4296-8e3e-87794aec591a" returned: 0 in 1.502s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Lock "cinder-quobyte-6bacabe1-f42e-4296-8e3e-87794aec591a" released by "delete_volume" :: held 3.184s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Created reservations ['a1da5897-415e-4faa-8933-028cbee10105', '91694ed8-424e-4f8f-b32a-855b1e3d4bed', '89b4ace6-8064-4f46-8409-3b00844976a8', '135d0ef7-22a6-4da3-9166-f5591059926d'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:42:55 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.638s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 8 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:55 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 1073741824" returned: 0 in 2.048s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:55 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:42:55 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:42:55 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 Jul 08 10:42:55 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:42:56 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.074s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:56 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:42:56 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Deleted volume successfully. Jul 08 10:42:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7ab48152-f72d-4b62-af3f-b5780753ffe3 tempest-SnapshotsActionsTest-298402846 None] Lock "cinder-6bacabe1-f42e-4296-8e3e-87794aec591a-delete_volume" released by "delete_volume" :: held 4.697s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:42:56 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Jul 08 10:42:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6" returned: 0 in 1.163s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:42:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] <== create_volume: return (3274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:42:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.278s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:42:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a7f068-4cc1-48e8-96ef-c8aab4a15801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a22f8de-c007-4e7d-ae98-8bf8059d7f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:42:56 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Volume volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 (4dcd3ef2-0c1f-4608-93de-e877ee9687b6): created successfully Jul 08 10:42:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a22f8de-c007-4e7d-ae98-8bf8059d7f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:42:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Flow 'volume_create_manager' (3719a29a-e4af-4f15-b913-f2719efa1f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:42:56 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f39eacfc-c425-4763-a4ed-798223742273 tempest-GroupSnapshotsTest-1715497858 None] Created volume successfully. Jul 08 10:42:57 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-94fc2744-ea7f-4b08-b220-e3e435339c4a tempest-GroupSnapshotsTest-1715497858 None] Update group completed successfully. Jul 08 10:42:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-779d7699-7625-4b27-b9c7-96f634fab9cb tempest-GroupSnapshotsTest-1715497858 None] Update group completed successfully. Jul 08 10:43:00 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e63d6974-403d-4d41-acdf-c2b2ba8787ff tempest-GroupSnapshotsTest-1715497858 None] Update group completed successfully. Jul 08 10:43:01 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4f35c550-822f-40d3-9e96-52a99ee6fc62 tempest-GroupSnapshotsTest-1715497858 None] Update group completed successfully. Jul 08 10:43:03 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] GroupSnapshot 29b4a89a-3b2a-47e4-b5bf-82b8dae0b560: creating. Jul 08 10:43:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Group snapshot 29b4a89a-3b2a-47e4-b5bf-82b8dae0b560: creating. {{(pid=86913) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 10:43:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Creating offline snapshot 336bc035-dab0-4484-b931-04ea1c7c3f3b of volume 2c312bae-b324-4ab4-8708-68ff9b1c6df6 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:43:03 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f73eee3-8470-4ec1-859d-c06cb03a4ea8]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:03 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 Jul 08 10:43:03 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:04 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6" returned: 0 in 1.030s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:04 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b 1G Jul 08 10:43:04 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:05 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b 1G" returned: 0 in 0.978s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:05 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b Jul 08 10:43:05 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:06 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b" returned: 0 in 0.853s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:06 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:43:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:06 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b Jul 08 10:43:06 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:07 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b" returned: 0 in 0.692s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:07 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.info Jul 08 10:43:07 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:08 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.info" returned: 0 in 0.775s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:08 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:43:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:08 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.info Jul 08 10:43:08 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:08 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.info" returned: 0 in 0.799s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.239s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Creating offline snapshot 7a179a8d-f239-4dd8-ba44-81f8acb5c8ae of volume 4dcd3ef2-0c1f-4608-93de-e877ee9687b6 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:43:09 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52f1eac-2f8c-4c30-930c-a2e73af821d0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:09 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 Jul 08 10:43:09 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:10 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6" returned: 0 in 0.956s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:10 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae 1G Jul 08 10:43:10 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:11 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae 1G" returned: 0 in 1.119s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:11 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae Jul 08 10:43:11 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:12 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae" returned: 0 in 0.939s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:12 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:43:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:12 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae Jul 08 10:43:12 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:12 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae" returned: 0 in 0.871s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:13 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.info Jul 08 10:43:13 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:13 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.info" returned: 0 in 0.980s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:13 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:43:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:14 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.info Jul 08 10:43:14 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:14 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.info" returned: 0 in 0.856s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.862s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:14 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-97750d46-37a3-4bc0-843e-037793115353 tempest-GroupSnapshotsTest-1715497858 None] group_snapshot 29b4a89a-3b2a-47e4-b5bf-82b8dae0b560: created successfully Jul 08 10:43:15 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] group_snapshot 29b4a89a-3b2a-47e4-b5bf-82b8dae0b560: deleting Jul 08 10:43:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] group_snapshot 29b4a89a-3b2a-47e4-b5bf-82b8dae0b560: deleting {{(pid=86913) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 10:43:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-2c312bae-b324-4ab4-8708-68ff9b1c6df6" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-2c312bae-b324-4ab4-8708-68ff9b1c6df6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-336bc035-dab0-4484-b931-04ea1c7c3f3b" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-336bc035-dab0-4484-b931-04ea1c7c3f3b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Deleting offline snapshot 336bc035-dab0-4484-b931-04ea1c7c3f3b of volume 2c312bae-b324-4ab4-8708-68ff9b1c6df6 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:43:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] snapshot_file for this snap is: volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:43:15 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6ff117-9f36-416c-8dc8-8fc966ca43bb]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:15 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b Jul 08 10:43:15 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:16 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b" returned: 0 in 0.898s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:43:16 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[97089ffc-3b26-4d88-80f0-afd271b8328d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:16 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 Jul 08 10:43:16 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:17 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6" returned: 0 in 0.981s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:17 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b Jul 08 10:43:17 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Flow 'volume_create_manager' (a0fd0b8e-589b-423a-bd97-2862a7dbd3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67efdea9-8513-4412-880f-bf9e03186c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67efdea9-8513-4412-880f-bf9e03186c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-847738313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd76b6eb-768f-46c0-a3e2-fd74920ad4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5836cd8c9caa4bc39c1fe73c3e0368a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:43:18Z,use_quota=True,user_id='a9d6507d6b8144dfb8595903d026e713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c611380-328a-45bd-b668-e719323ca1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c611380-328a-45bd-b668-e719323ca1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9196ef49-4f7a-4988-b4cb-76c4df89532f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9196ef49-4f7a-4988-b4cb-76c4df89532f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd76b6eb-768f-46c0-a3e2-fd74920ad4e9', 'volume_name': 'volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48d3f35-1c23-4338-9ea7-f93c51a14c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48d3f35-1c23-4338-9ea7-f93c51a14c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b3899b-d4a5-4ef6-893c-bad500e8a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:18 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Volume cd76b6eb-768f-46c0-a3e2-fd74920ad4e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9', 'volume_size': 1} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-847738313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd76b6eb-768f-46c0-a3e2-fd74920ad4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5836cd8c9caa4bc39c1fe73c3e0368a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:43:18Z,use_quota=True,user_id='a9d6507d6b8144dfb8595903d026e713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Creating volume cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:43:18 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:18 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 1073741824 Jul 08 10:43:18 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:18 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b" returned: 0 in 1.066s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:18 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b Jul 08 10:43:18 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:19 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6.336bc035-dab0-4484-b931-04ea1c7c3f3b" returned: 0 in 0.876s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-336bc035-dab0-4484-b931-04ea1c7c3f3b" released by "_delete_snapshot" :: held 3.994s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-2c312bae-b324-4ab4-8708-68ff9b1c6df6" released by "delete_snapshot" :: held 4.028s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-4dcd3ef2-0c1f-4608-93de-e877ee9687b6" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:19 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 1073741824" returned: 0 in 1.130s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-4dcd3ef2-0c1f-4608-93de-e877ee9687b6" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-7a179a8d-f239-4dd8-ba44-81f8acb5c8ae" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-7a179a8d-f239-4dd8-ba44-81f8acb5c8ae" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Deleting offline snapshot 7a179a8d-f239-4dd8-ba44-81f8acb5c8ae of volume 4dcd3ef2-0c1f-4608-93de-e877ee9687b6 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] snapshot_file for this snap is: volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c60eec-7763-49a8-bb6d-209a67f378a7]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:19 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 Jul 08 10:43:19 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:19 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae Jul 08 10:43:19 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:20 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9" returned: 0 in 0.822s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:43:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b3899b-d4a5-4ef6-893c-bad500e8a875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53d7442-dd5d-463b-8ad0-aa55400902b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:20 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Volume volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 (cd76b6eb-768f-46c0-a3e2-fd74920ad4e9): created successfully Jul 08 10:43:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53d7442-dd5d-463b-8ad0-aa55400902b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Flow 'volume_create_manager' (a0fd0b8e-589b-423a-bd97-2862a7dbd3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:43:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a4dcc93e-4482-44af-99a7-9a1758c4efa8 tempest-AttachVolumeNegativeTest-1715871990 None] Created volume successfully. Jul 08 10:43:20 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae" returned: 0 in 0.947s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:43:20 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34fcaf0-991d-4b7b-82a6-f813f2fec193]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:20 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 Jul 08 10:43:20 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:21 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6" returned: 0 in 0.878s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:21 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae Jul 08 10:43:21 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Flow 'volume_create_manager' (e324f842-b102-4f79-a5fe-e7ce8bacd95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4519aedb-bdd2-4cdb-bf7f-af5e599ed399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4519aedb-bdd2-4cdb-bf7f-af5e599ed399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2002386477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6669ab30-4a63-459e-be3b-5603fb36ef87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe736061a6c48f1a19b88be3dba5e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:43:22Z,use_quota=True,user_id='649a2959aa87476b9fa721f91c0b75d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ce7ef1-7c31-4508-9d60-4febf55ee989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ce7ef1-7c31-4508-9d60-4febf55ee989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0068bfc-71da-47ea-a6cb-5a158fe9b7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0068bfc-71da-47ea-a6cb-5a158fe9b7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6669ab30-4a63-459e-be3b-5603fb36ef87', 'volume_name': 'volume-6669ab30-4a63-459e-be3b-5603fb36ef87', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cc0048-07f4-42fc-9314-00dd3a67f69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cc0048-07f4-42fc-9314-00dd3a67f69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c716fe47-ca24-4529-832a-6263747f956a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:22 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Volume 6669ab30-4a63-459e-be3b-5603fb36ef87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6669ab30-4a63-459e-be3b-5603fb36ef87', 'volume_size': 1} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2002386477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6669ab30-4a63-459e-be3b-5603fb36ef87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe736061a6c48f1a19b88be3dba5e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:43:22Z,use_quota=True,user_id='649a2959aa87476b9fa721f91c0b75d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Creating volume 6669ab30-4a63-459e-be3b-5603fb36ef87 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:43:22 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:22 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87 1073741824 Jul 08 10:43:22 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:22 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae" returned: 0 in 0.917s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:22 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae Jul 08 10:43:22 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:23 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6.7a179a8d-f239-4dd8-ba44-81f8acb5c8ae" returned: 0 in 0.782s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-7a179a8d-f239-4dd8-ba44-81f8acb5c8ae" released by "_delete_snapshot" :: held 3.673s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-4dcd3ef2-0c1f-4608-93de-e877ee9687b6" released by "delete_snapshot" :: held 3.706s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:23 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87 1073741824" returned: 0 in 1.043s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:23 devstack cinder-volume[86913]: WARNING cinder.quota [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-684642420 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-684642420, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:43:23 devstack cinder-volume[86913]: WARNING cinder.quota [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-684642420 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-684642420, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:43:23 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['1fba72e5-304d-48c0-a1f4-033698c421a7', 'b91e9aae-1922-495e-b78c-544378f5efac', '42b58027-641c-4cf9-8e3b-d118757ace3e', '398db921-3a2c-45cc-8c15-1b44f8f76e78'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:43:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:23 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87 Jul 08 10:43:23 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:23 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['8be83299-1ea7-4b05-9058-b525ef5b5da3', '3391c8f1-9ec1-41b1-be73-bdd4daeac1c7', 'cd0b0528-5fff-43fc-ae38-e90288eb77d4', '90643cdf-bb1e-4937-904e-609e223490df'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:43:23 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-235e61a4-06f1-4afe-913f-2cf9afa4932d tempest-GroupSnapshotsTest-1715497858 None] group_snapshot 29b4a89a-3b2a-47e4-b5bf-82b8dae0b560: deleted successfully Jul 08 10:43:24 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87" returned: 0 in 0.670s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c716fe47-ca24-4529-832a-6263747f956a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6669ab30-4a63-459e-be3b-5603fb36ef87', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4978e311-fe8d-4a00-90a9-9d54949122a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:24 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Volume volume-6669ab30-4a63-459e-be3b-5603fb36ef87 (6669ab30-4a63-459e-be3b-5603fb36ef87): created successfully Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4978e311-fe8d-4a00-90a9-9d54949122a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Flow 'volume_create_manager' (e324f842-b102-4f79-a5fe-e7ce8bacd95e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:43:24 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2ae0c649-a90d-4353-adfc-2de672e928a5 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Created volume successfully. Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-2c312bae-b324-4ab4-8708-68ff9b1c6df6" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-2c312bae-b324-4ab4-8708-68ff9b1c6df6" acquired by "delete_volume" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-d9a08b91-b10b-438f-908c-fcd2baf8ac52 req-81020bf3-e41d-4a4d-ba24-0c0a0bc913d0 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-d9a08b91-b10b-438f-908c-fcd2baf8ac52 req-81020bf3-e41d-4a4d-ba24-0c0a0bc913d0 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2478a956-d1f7-4fa5-8677-b25ae64aa812]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07e8156-02ad-4a16-9489-a3d91c6e1555]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-d9a08b91-b10b-438f-908c-fcd2baf8ac52 req-81020bf3-e41d-4a4d-ba24-0c0a0bc913d0 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:25 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 Jul 08 10:43:25 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:25 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 Jul 08 10:43:25 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Acquiring lock "cinder-6669ab30-4a63-459e-be3b-5603fb36ef87-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Lock "cinder-6669ab30-4a63-459e-be3b-5603fb36ef87-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Acquiring lock "cinder-quobyte-6669ab30-4a63-459e-be3b-5603fb36ef87" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Lock "cinder-quobyte-6669ab30-4a63-459e-be3b-5603fb36ef87" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd908bae-8351-4612-9804-7bfc0f8c6910]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:25 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6" returned: 0 in 0.917s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:25 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6 Jul 08 10:43:25 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:25 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-d9a08b91-b10b-438f-908c-fcd2baf8ac52 req-81020bf3-e41d-4a4d-ba24-0c0a0bc913d0 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9" returned: 0 in 0.934s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-d9a08b91-b10b-438f-908c-fcd2baf8ac52 req-81020bf3-e41d-4a4d-ba24-0c0a0bc913d0 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.963s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-d9a08b91-b10b-438f-908c-fcd2baf8ac52 req-81020bf3-e41d-4a4d-ba24-0c0a0bc913d0 tempest-AttachVolumeNegativeTest-1715871990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff419345-592f-43ad-a683-597ad350f697', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:43:25 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87 Jul 08 10:43:25 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:26 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-d9a08b91-b10b-438f-908c-fcd2baf8ac52 req-81020bf3-e41d-4a4d-ba24-0c0a0bc913d0 tempest-AttachVolumeNegativeTest-1715871990 None] attachment_update completed successfully. Jul 08 10:43:26 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2c312bae-b324-4ab4-8708-68ff9b1c6df6" returned: 0 in 0.741s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-2c312bae-b324-4ab4-8708-68ff9b1c6df6" released by "delete_volume" :: held 1.770s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-4dcd3ef2-0c1f-4608-93de-e877ee9687b6" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-4dcd3ef2-0c1f-4608-93de-e877ee9687b6" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:26 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[550f6e30-c2b4-4664-ba21-8b63d616ff98]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:26 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87" returned: 0 in 0.945s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:26 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87 Jul 08 10:43:26 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:26 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 Jul 08 10:43:26 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:27 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6669ab30-4a63-459e-be3b-5603fb36ef87" returned: 0 in 0.788s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Lock "cinder-quobyte-6669ab30-4a63-459e-be3b-5603fb36ef87" released by "delete_volume" :: held 1.796s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:27 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Created reservations ['1029fc64-2076-45b0-8acf-a7b9af372988', 'ec746b1c-0287-424b-ada9-ea7e088d8e91', 'e0e1808b-5fc6-4d01-ac3a-83d314989b96', '8ef98737-7182-4545-ad6f-bc0fa5a5de39'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:43:27 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6" returned: 0 in 1.075s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:43:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:43:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:27 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6 Jul 08 10:43:27 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:27 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:43:27 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:28 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.020s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:28 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:43:28 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Deleted volume successfully. Jul 08 10:43:28 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4dcd3ef2-0c1f-4608-93de-e877ee9687b6" returned: 0 in 1.130s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-73ca86a4-375c-4239-8006-42d1888efc60 tempest-VolumeQuotasNegativeTestJSON-449344570 None] Lock "cinder-6669ab30-4a63-459e-be3b-5603fb36ef87-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-4dcd3ef2-0c1f-4608-93de-e877ee9687b6" released by "delete_volume" :: held 2.297s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:29 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['d45bb72c-cf94-4697-a9b2-22689ea91d9e'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:43:29 devstack cinder-volume[86913]: WARNING cinder.quota [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-684642420 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-684642420, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:43:29 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['95681728-4d3f-4e2e-90f1-231bec7ccf64', '67a6d3d5-18e9-495b-9f50-9c6f5abbf40a', '8de9f7a6-469a-46aa-93a0-2ed76d7f3c82', 'fe625b90-96fb-40f2-804d-ff28af25044b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:43:29 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['64af6406-2082-49e3-a001-4d9b08fbfbc3', '902081ce-2982-4641-99b1-967a8d33ccd2', '4b4b8656-e63c-49b2-99c5-af35de9a9e25', '086e6d97-9a4b-4a2f-8927-49aa224bce17'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:43:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:43:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:43:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:29 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:43:29 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:30 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.810s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:30 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:43:30 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e21287f4-f30a-4eaf-af52-fe9b9a1c34a4 tempest-GroupSnapshotsTest-1715497858 None] Delete group completed successfully. Jul 08 10:43:30 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5cdce51e-be13-410d-b61c-9ffad9e91706 tempest-GroupSnapshotsTest-1715497858 None] Group tempest-GroupSnapshotsTest-Group-6562169: creating Jul 08 10:43:30 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5cdce51e-be13-410d-b61c-9ffad9e91706 tempest-GroupSnapshotsTest-1715497858 None] Group tempest-GroupSnapshotsTest-Group-6562169: created successfully Jul 08 10:43:30 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5cdce51e-be13-410d-b61c-9ffad9e91706 tempest-GroupSnapshotsTest-1715497858 None] Create group completed successfully. Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Flow 'volume_create_manager' (3cbc6dd9-524e-459f-8f44-9264d48eab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80626533-ff08-4d9f-8cf9-5391ab00a7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80626533-ff08-4d9f-8cf9-5391ab00a7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-246666371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bbe83eb9-5b06-470d-a186-3c78797c13d2,host='devstack@QuobyteHD#QuobyteHD',id=da501bba-4370-4599-b104-85f079db6e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68699462087466f9356cda2355530c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:43:32Z,use_quota=True,user_id='cd5d028673e242b5bb7fde0048f1b4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4ce1987-e36a-432a-be7f-6bd5b902d532),volume_type_id=f4ce1987-e36a-432a-be7f-6bd5b902d532)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06602a88-fe4f-4fb2-8c2f-ef8babe36973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06602a88-fe4f-4fb2-8c2f-ef8babe36973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7876a464-6b01-459e-b1f8-7b91484addd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7876a464-6b01-459e-b1f8-7b91484addd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da501bba-4370-4599-b104-85f079db6e96', 'volume_name': 'volume-da501bba-4370-4599-b104-85f079db6e96', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4317b2ac-8577-4959-b217-4c93a004a7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4317b2ac-8577-4959-b217-4c93a004a7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9defd282-f33f-4ab5-8042-6ac0c0cb581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:32 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Volume da501bba-4370-4599-b104-85f079db6e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da501bba-4370-4599-b104-85f079db6e96', 'volume_size': 1} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bbe83eb9-5b06-470d-a186-3c78797c13d2,created_at=2026-07-08T08:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-246666371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bbe83eb9-5b06-470d-a186-3c78797c13d2,host='devstack@QuobyteHD#QuobyteHD',id=da501bba-4370-4599-b104-85f079db6e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68699462087466f9356cda2355530c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:43:32Z,use_quota=True,user_id='cd5d028673e242b5bb7fde0048f1b4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4ce1987-e36a-432a-be7f-6bd5b902d532),volume_type_id=f4ce1987-e36a-432a-be7f-6bd5b902d532)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Creating volume da501bba-4370-4599-b104-85f079db6e96 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:43:32 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:43:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:32 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 1073741824 Jul 08 10:43:32 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:33 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 1073741824" returned: 0 in 1.163s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:33 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 Jul 08 10:43:33 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:34 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96" returned: 0 in 1.090s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] <== create_volume: return (2346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:43:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.348s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9defd282-f33f-4ab5-8042-6ac0c0cb581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da501bba-4370-4599-b104-85f079db6e96', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddb3086-4841-44d6-bcd6-1473bd31d9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:34 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Volume volume-da501bba-4370-4599-b104-85f079db6e96 (da501bba-4370-4599-b104-85f079db6e96): created successfully Jul 08 10:43:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddb3086-4841-44d6-bcd6-1473bd31d9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Flow 'volume_create_manager' (3cbc6dd9-524e-459f-8f44-9264d48eab48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:43:34 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8cc2a4eb-6641-4afd-bde1-c251bf632fbd tempest-GroupSnapshotsTest-1715497858 None] Created volume successfully. Jul 08 10:43:35 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] GroupSnapshot a33d9194-2a56-47c4-8b31-d5cbaae0d42c: creating. Jul 08 10:43:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] Group snapshot a33d9194-2a56-47c4-8b31-d5cbaae0d42c: creating. {{(pid=86913) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 10:43:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] Creating offline snapshot d8fda55c-e42c-4937-aabf-72be386db6cc of volume da501bba-4370-4599-b104-85f079db6e96 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:43:35 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb03205-3e19-416f-b8eb-9be76f0b0bae]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:35 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 Jul 08 10:43:35 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:36 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96" returned: 0 in 1.149s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:36 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc 1G Jul 08 10:43:36 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:37 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc 1G" returned: 0 in 1.166s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da501bba-4370-4599-b104-85f079db6e96 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:37 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da501bba-4370-4599-b104-85f079db6e96 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc Jul 08 10:43:37 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:39 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da501bba-4370-4599-b104-85f079db6e96 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc" returned: 0 in 1.089s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:39 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:43:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:39 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc Jul 08 10:43:39 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:39 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc" returned: 0 in 0.970s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:40 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.info Jul 08 10:43:40 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:41 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.info" returned: 0 in 1.208s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:41 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:43:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:41 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.info Jul 08 10:43:41 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:42 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.info" returned: 0 in 1.181s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.907s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:42 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a338787b-ba46-4420-a16b-071e071a1aaf tempest-GroupSnapshotsTest-1715497858 None] group_snapshot a33d9194-2a56-47c4-8b31-d5cbaae0d42c: created successfully Jul 08 10:43:43 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] group_snapshot a33d9194-2a56-47c4-8b31-d5cbaae0d42c: deleting Jul 08 10:43:43 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=103,cinder:INSERT=26,cinder:UPDATE=98,cinder:DELETE=4 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:43:43 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:INSERT=28,cinder:UPDATE=121,cinder:SELECT=105,cinder:DELETE=4 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:43:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] group_snapshot a33d9194-2a56-47c4-8b31-d5cbaae0d42c: deleting {{(pid=86913) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 10:43:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-da501bba-4370-4599-b104-85f079db6e96" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-da501bba-4370-4599-b104-85f079db6e96" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-d8fda55c-e42c-4937-aabf-72be386db6cc" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-d8fda55c-e42c-4937-aabf-72be386db6cc" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Deleting offline snapshot d8fda55c-e42c-4937-aabf-72be386db6cc of volume da501bba-4370-4599-b104-85f079db6e96 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:43:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] snapshot_file for this snap is: volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:43:43 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a560fe2-3a51-4559-87a4-853f3678476a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:43 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc Jul 08 10:43:43 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Flow 'volume_create_manager' (62d6645f-b596-41b6-bcef-bab146fc048c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffacb22e-8eda-4003-b042-b993241faf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffacb22e-8eda-4003-b042-b993241faf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1371531599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf00249-13be-4a21-a140-f0d52aaa8592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22aefa99f1fc455abdde21b4f5f19335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:43:44Z,use_quota=True,user_id='64840999a21e479bb410f60f0f45d203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74389e16-1f97-444b-a731-8c626ffdcfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74389e16-1f97-444b-a731-8c626ffdcfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406388c8-c568-48a4-8bf3-c17380e95b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406388c8-c568-48a4-8bf3-c17380e95b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf00249-13be-4a21-a140-f0d52aaa8592', 'volume_name': 'volume-acf00249-13be-4a21-a140-f0d52aaa8592', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eff8caf-da2d-49c6-b2c0-9b55ccf4dd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eff8caf-da2d-49c6-b2c0-9b55ccf4dd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4685af5c-453b-4c48-b958-4906e6eb7bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:44 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Volume acf00249-13be-4a21-a140-f0d52aaa8592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf00249-13be-4a21-a140-f0d52aaa8592', 'volume_size': 1} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1371531599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf00249-13be-4a21-a140-f0d52aaa8592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22aefa99f1fc455abdde21b4f5f19335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:43:44Z,use_quota=True,user_id='64840999a21e479bb410f60f0f45d203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Creating volume acf00249-13be-4a21-a140-f0d52aaa8592 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:43:44 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:44 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 1073741824 Jul 08 10:43:44 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:44 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc" returned: 0 in 1.204s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da501bba-4370-4599-b104-85f079db6e96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceb5311-100b-45b9-aef0-0c6956f6f8b2]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:45 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 Jul 08 10:43:45 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:45 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 1073741824" returned: 0 in 1.224s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:45 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 Jul 08 10:43:45 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:45 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96" returned: 0 in 0.969s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:45 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc Jul 08 10:43:45 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:46 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592" returned: 0 in 0.765s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:43:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4685af5c-453b-4c48-b958-4906e6eb7bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf00249-13be-4a21-a140-f0d52aaa8592', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4df547b-806f-4269-bb8f-59fc47ed1056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:43:46 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Volume volume-acf00249-13be-4a21-a140-f0d52aaa8592 (acf00249-13be-4a21-a140-f0d52aaa8592): created successfully Jul 08 10:43:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4df547b-806f-4269-bb8f-59fc47ed1056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:43:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Flow 'volume_create_manager' (62d6645f-b596-41b6-bcef-bab146fc048c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:43:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a85b90f8-2209-4290-afa6-03a13b0e7e78 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Created volume successfully. Jul 08 10:43:46 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc" returned: 0 in 0.815s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:46 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc Jul 08 10:43:46 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:47 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96.d8fda55c-e42c-4937-aabf-72be386db6cc" returned: 0 in 0.734s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-d8fda55c-e42c-4937-aabf-72be386db6cc" released by "_delete_snapshot" :: held 3.884s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-da501bba-4370-4599-b104-85f079db6e96" released by "delete_snapshot" :: held 3.925s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:47 devstack cinder-volume[86913]: WARNING cinder.quota [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2007399785 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2007399785, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:43:47 devstack cinder-volume[86913]: WARNING cinder.quota [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2007399785 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2007399785, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:43:47 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['c1a038d4-bc82-42f6-aa9b-a41910000064', '1304a207-e516-4112-87c0-0f15c81b5c0d', '5a69013c-7ac6-45ee-9b1b-7bc4ba12a45d', '0623efd2-883e-4565-80d1-2be72f4cf178'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:43:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Creating offline snapshot cd91f169-ff00-4a8d-a6b0-43712bdbc52f of volume acf00249-13be-4a21-a140-f0d52aaa8592 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:43:47 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c4fe11-d1ae-4516-a9b8-d5eb892c2305]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c6573e65-129a-43f9-8e8d-7cd33dab1cbf tempest-GroupSnapshotsTest-1715497858 None] group_snapshot a33d9194-2a56-47c4-8b31-d5cbaae0d42c: deleted successfully Jul 08 10:43:47 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 Jul 08 10:43:47 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "cinder-quobyte-da501bba-4370-4599-b104-85f079db6e96" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-da501bba-4370-4599-b104-85f079db6e96" acquired by "delete_volume" :: waited 0.044s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:48 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[3049e641-4348-4422-a540-c4a212ea5a35]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:48 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 Jul 08 10:43:48 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:49 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592" returned: 0 in 1.420s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:49 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f 1G Jul 08 10:43:49 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:49 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96" returned: 0 in 1.069s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:49 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96 Jul 08 10:43:49 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:50 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f 1G" returned: 0 in 0.999s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf00249-13be-4a21-a140-f0d52aaa8592 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:50 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf00249-13be-4a21-a140-f0d52aaa8592 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f Jul 08 10:43:50 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:50 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-da501bba-4370-4599-b104-85f079db6e96" returned: 0 in 0.710s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Lock "cinder-quobyte-da501bba-4370-4599-b104-85f079db6e96" released by "delete_volume" :: held 1.923s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['ede8949f-ef7a-48d7-9f01-00841c1c0453'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:43:50 devstack cinder-volume[86913]: WARNING cinder.quota [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2007399785 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2007399785, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Created reservations ['3d4e10bf-3119-48a1-8fd0-d072718f6076', '78294f39-e1e1-4594-910b-ac29d8f71aa8', '439d5789-6c34-4422-99c6-e57c7c1c2f67', '01279458-8c3d-4ee2-8336-b10a6fff71dc'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:50 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:43:50 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:50 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf00249-13be-4a21-a140-f0d52aaa8592 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f" returned: 0 in 0.822s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:50 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f is being set with open permissions: ugo+rw Jul 08 10:43:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:51 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f Jul 08 10:43:51 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:51 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.790s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:51 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:43:51 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c38a07b5-cc75-47d4-a36e-0d489a9e9520 tempest-GroupSnapshotsTest-1715497858 None] Delete group completed successfully. Jul 08 10:43:51 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f" returned: 0 in 0.962s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:52 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.info Jul 08 10:43:52 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:52 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.info" returned: 0 in 0.765s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:52 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.info is being set with open permissions: ugo+rw Jul 08 10:43:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:52 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.info Jul 08 10:43:52 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:53 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.info" returned: 0 in 0.929s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.028s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:53 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6d501970-4d81-46d5-80cd-6dc2293b8436 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Create snapshot completed successfully Jul 08 10:43:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:43:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:43:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:43:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:43:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:43:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:43:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:53 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:43:53 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Acquiring lock "cinder-cd91f169-ff00-4a8d-a6b0-43712bdbc52f-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:55 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.187s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "cinder-cd91f169-ff00-4a8d-a6b0-43712bdbc52f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Acquiring lock "cinder-quobyte-acf00249-13be-4a21-a140-f0d52aaa8592" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 8 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "cinder-quobyte-acf00249-13be-4a21-a140-f0d52aaa8592" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Acquiring lock "cinder-quobyte-cd91f169-ff00-4a8d-a6b0-43712bdbc52f" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "cinder-quobyte-cd91f169-ff00-4a8d-a6b0-43712bdbc52f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Deleting offline snapshot cd91f169-ff00-4a8d-a6b0-43712bdbc52f of volume acf00249-13be-4a21-a140-f0d52aaa8592 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] snapshot_file for this snap is: volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[253cb4af-01c0-42a1-b73c-46f7daf74b85]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:55 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f Jul 08 10:43:55 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:56 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f" returned: 0 in 1.115s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acf00249-13be-4a21-a140-f0d52aaa8592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:43:56 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f0f9ce-c4af-447d-b2fc-0f59068c9671]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:43:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:56 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 Jul 08 10:43:56 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:57 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592" returned: 0 in 1.204s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:57 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f Jul 08 10:43:57 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:58 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f" returned: 0 in 0.975s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:43:58 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f Jul 08 10:43:58 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:43:59 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Jul 08 10:43:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592.cd91f169-ff00-4a8d-a6b0-43712bdbc52f" returned: 0 in 0.863s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:43:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "cinder-quobyte-cd91f169-ff00-4a8d-a6b0-43712bdbc52f" released by "_delete_snapshot" :: held 4.318s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "cinder-quobyte-acf00249-13be-4a21-a140-f0d52aaa8592" released by "delete_snapshot" :: held 4.353s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:43:59 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Created reservations ['8ed1bd12-531c-4a2f-af61-99f7fc8fd76a', 'd4c8e6fc-f76d-4eab-9c2c-81d079e80e41', '500ffbed-e395-4a93-aa8a-36c7d9ec28fa', '5c051561-f806-4a79-8350-68dff141409d'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:43:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Delete snapshot completed successfully. Jul 08 10:43:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ee9b332e-9082-4553-a1c8-9ba21067a821 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "cinder-cd91f169-ff00-4a8d-a6b0-43712bdbc52f-delete_snapshot" released by "delete_snapshot" :: held 4.544s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Acquiring lock "cinder-acf00249-13be-4a21-a140-f0d52aaa8592-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "cinder-acf00249-13be-4a21-a140-f0d52aaa8592-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Acquiring lock "cinder-quobyte-acf00249-13be-4a21-a140-f0d52aaa8592" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "cinder-quobyte-acf00249-13be-4a21-a140-f0d52aaa8592" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:00 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[239700d1-3b12-4ea7-86a8-0e8565a2b538]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:44:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:00 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 Jul 08 10:44:00 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Flow 'volume_create_manager' (a0027a09-3eb9-46c1-8c1c-70253ee7e422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac8c153-dba2-497d-a753-7c51d4c240f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:02 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592" returned: 0 in 1.346s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac8c153-dba2-497d-a753-7c51d4c240f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2003002659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3735fd07-f29a-472d-8d86-9e216ce31b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f25b744068b4576a7458b7ba882fef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:02Z,use_quota=True,user_id='b94890ca1d5947fba729d16b1528c574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:02 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592 Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a38402-f676-46a8-8676-e704840acde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:02 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a38402-f676-46a8-8676-e704840acde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d58d7d8-03e5-43a0-93b7-8e0b19c90f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d58d7d8-03e5-43a0-93b7-8e0b19c90f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3735fd07-f29a-472d-8d86-9e216ce31b80', 'volume_name': 'volume-3735fd07-f29a-472d-8d86-9e216ce31b80', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a0b37d-37ce-4674-8430-b42c0ad854e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a0b37d-37ce-4674-8430-b42c0ad854e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e21d91-2802-441c-819c-1ed761511f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:02 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Volume 3735fd07-f29a-472d-8d86-9e216ce31b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3735fd07-f29a-472d-8d86-9e216ce31b80', 'volume_size': 1} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2003002659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3735fd07-f29a-472d-8d86-9e216ce31b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f25b744068b4576a7458b7ba882fef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:02Z,use_quota=True,user_id='b94890ca1d5947fba729d16b1528c574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Creating volume 3735fd07-f29a-472d-8d86-9e216ce31b80 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:44:02 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:44:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:02 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 1073741824 Jul 08 10:44:02 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:03 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-acf00249-13be-4a21-a140-f0d52aaa8592" returned: 0 in 1.170s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:03 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "cinder-quobyte-acf00249-13be-4a21-a140-f0d52aaa8592" released by "delete_volume" :: held 2.640s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:03 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Created reservations ['36e4a74c-7f47-43f5-b6fb-fbea05a50d57', 'f2c36a7f-5e5b-4b96-ac2b-adb0bf5735bc', '7f8204ab-c6d0-4cdc-94c5-8305c22314b0', '37dc9b50-bdda-4629-a07c-890248a34892'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:44:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:03 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:44:03 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:04 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 1073741824" returned: 0 in 2.014s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:04 devstack sudo[91815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 Jul 08 10:44:04 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:04 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.274s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:04 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:44:04 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Deleted volume successfully. Jul 08 10:44:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-425fe10b-90c0-47d2-89a4-b040a8852ae2 tempest-VolumeSnapshotQuotasNegativeTestJSON-797962043 None] Lock "cinder-acf00249-13be-4a21-a140-f0d52aaa8592-delete_volume" released by "delete_volume" :: held 4.306s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:05 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80" returned: 0 in 1.164s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] <== create_volume: return (3295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:44:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.298s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e21d91-2802-441c-819c-1ed761511f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3735fd07-f29a-472d-8d86-9e216ce31b80', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63ccaf0-e0f3-466f-931e-0fca2138405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:05 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Volume volume-3735fd07-f29a-472d-8d86-9e216ce31b80 (3735fd07-f29a-472d-8d86-9e216ce31b80): created successfully Jul 08 10:44:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63ccaf0-e0f3-466f-931e-0fca2138405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Flow 'volume_create_manager' (a0027a09-3eb9-46c1-8c1c-70253ee7e422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-87b6688b-0cc8-43d1-acb5-ef7e7972c378 tempest-ServerActionsTestOtherA-1358319655 None] Created volume successfully. Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Flow 'volume_create_manager' (16b258b8-a0ab-4253-be6d-9c7798ff2082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f007fe06-99ce-4246-b4ef-7452c58a42f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f007fe06-99ce-4246-b4ef-7452c58a42f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1319557793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d54b1b-1e0d-473f-8a43-b2011313ae1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab40b0cff85b4ae8834716f2ead29371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:12Z,use_quota=True,user_id='3f99bf5e1aea45d89b2d36834e704e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75aa52b5-cd2a-4534-aa73-b9771de85d9c),volume_type_id=75aa52b5-cd2a-4534-aa73-b9771de85d9c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7fedbe-4c56-4edc-bf6b-30ebf9bc31de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7fedbe-4c56-4edc-bf6b-30ebf9bc31de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc09cd7-88e4-40c7-91bb-188784f97a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc09cd7-88e4-40c7-91bb-188784f97a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d54b1b-1e0d-473f-8a43-b2011313ae1e', 'volume_name': 'volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5a8ebd-e18d-4332-bc0f-93a8cd7bda12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5a8ebd-e18d-4332-bc0f-93a8cd7bda12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe708d11-afd2-45e4-9080-aaeef916434c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:12 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Volume 35d54b1b-1e0d-473f-8a43-b2011313ae1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e', 'volume_size': 1} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1319557793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d54b1b-1e0d-473f-8a43-b2011313ae1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab40b0cff85b4ae8834716f2ead29371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:12Z,use_quota=True,user_id='3f99bf5e1aea45d89b2d36834e704e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75aa52b5-cd2a-4534-aa73-b9771de85d9c),volume_type_id=75aa52b5-cd2a-4534-aa73-b9771de85d9c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Creating volume 35d54b1b-1e0d-473f-8a43-b2011313ae1e {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:44:12 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:44:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:12 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e 1073741824 Jul 08 10:44:12 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Flow 'volume_create_manager' (2f750e73-0af3-4eeb-9bba-5da3d5f49b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd12feb-d744-46b4-b2cb-2231a79fe358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd12feb-d744-46b4-b2cb-2231a79fe358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1702441262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f4eb9b-c121-488a-bc29-f0ddf84a35e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c735f1bb094674ad39205bd0b590eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:13Z,use_quota=True,user_id='f9d46dac7c3e45da9a1aeb4773f7b1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b1b8bd-7e3c-428f-8d76-55adb7e4621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b1b8bd-7e3c-428f-8d76-55adb7e4621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f8d1f0-e4ca-454c-8029-84d247300e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f8d1f0-e4ca-454c-8029-84d247300e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f4eb9b-c121-488a-bc29-f0ddf84a35e2', 'volume_name': 'volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3823bdc7-b012-461e-9f0a-fda331549757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3823bdc7-b012-461e-9f0a-fda331549757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d9dbad-dec1-40e0-820d-288c6df4831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:13 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Volume d8f4eb9b-c121-488a-bc29-f0ddf84a35e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2', 'volume_size': 1} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:13 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e 1073741824" returned: 0 in 1.018s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:13 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e Jul 08 10:44:13 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:14 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e" returned: 0 in 0.727s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1702441262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f4eb9b-c121-488a-bc29-f0ddf84a35e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c735f1bb094674ad39205bd0b590eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:13Z,use_quota=True,user_id='f9d46dac7c3e45da9a1aeb4773f7b1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Creating volume d8f4eb9b-c121-488a-bc29-f0ddf84a35e2 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:44:14 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe708d11-afd2-45e4-9080-aaeef916434c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0277a4-a7f9-4d54-b665-b420d9c3ffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:14 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2 1073741824 Jul 08 10:44:14 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:14 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Volume volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e (35d54b1b-1e0d-473f-8a43-b2011313ae1e): created successfully Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0277a4-a7f9-4d54-b665-b420d9c3ffa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Flow 'volume_create_manager' (16b258b8-a0ab-4253-be6d-9c7798ff2082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:14 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d6be645c-6c60-4c1d-8420-6a5fa5e987a3 tempest-VolumeTypesAccessTest-1662307074 None] Created volume successfully. Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Acquiring lock "cinder-35d54b1b-1e0d-473f-8a43-b2011313ae1e-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Lock "cinder-35d54b1b-1e0d-473f-8a43-b2011313ae1e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Acquiring lock "cinder-quobyte-35d54b1b-1e0d-473f-8a43-b2011313ae1e" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Lock "cinder-quobyte-35d54b1b-1e0d-473f-8a43-b2011313ae1e" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57cc8b8-9cd0-47ea-9e38-a97875fc8031]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:44:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:15 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e Jul 08 10:44:15 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:15 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2 1073741824" returned: 0 in 1.142s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:15 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2 Jul 08 10:44:15 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:16 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e" returned: 0 in 1.198s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:16 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e Jul 08 10:44:16 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:16 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2" returned: 0 in 0.854s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d9dbad-dec1-40e0-820d-288c6df4831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5ded7f-9f9e-44ba-a906-6b0734841cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:16 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Volume volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2 (d8f4eb9b-c121-488a-bc29-f0ddf84a35e2): created successfully Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5ded7f-9f9e-44ba-a906-6b0734841cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Flow 'volume_create_manager' (2f750e73-0af3-4eeb-9bba-5da3d5f49b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:16 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d29c81a1-84b0-425e-aab7-09500077e8f8 tempest-VolumesListAdminTestJSON-1574809989 None] Created volume successfully. Jul 08 10:44:16 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-35d54b1b-1e0d-473f-8a43-b2011313ae1e" returned: 0 in 0.758s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Lock "cinder-quobyte-35d54b1b-1e0d-473f-8a43-b2011313ae1e" released by "delete_volume" :: held 2.029s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:16 devstack cinder-volume[86913]: WARNING cinder.quota [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-71146264 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-71146264, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:44:16 devstack cinder-volume[86913]: WARNING cinder.quota [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-71146264 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-71146264, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:44:16 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Created reservations ['d2b3bbf4-0618-4c42-b4ce-4b6c5ec2934c', 'af73818d-3247-4089-8674-c2c933f3d5ce', '8df77e88-0252-438c-b440-653dee132bc7', '761c66cc-cc7e-4c1c-95a1-6026dd6d88e8'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:17 devstack sudo[91907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:44:17 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Flow 'volume_create_manager' (a1bd49bf-1a3f-4269-b37f-913eb399148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc172fe-fce0-47f5-9a2b-689ef817f296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc172fe-fce0-47f5-9a2b-689ef817f296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1562617830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9360fa89-f7ee-4ae6-8fb7-dbd940243ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c735f1bb094674ad39205bd0b590eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:17Z,use_quota=True,user_id='f9d46dac7c3e45da9a1aeb4773f7b1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7385d5-0979-4bf0-b14c-caca0011a6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7385d5-0979-4bf0-b14c-caca0011a6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8078b61e-cf4a-4526-804f-f16e1d803a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8078b61e-cf4a-4526-804f-f16e1d803a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9360fa89-f7ee-4ae6-8fb7-dbd940243ee6', 'volume_name': 'volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc87816-dbad-4408-b0d0-a66ee5c4b889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc87816-dbad-4408-b0d0-a66ee5c4b889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdd1c89-48e7-408f-9758-014ce8ad934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:17 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Volume 9360fa89-f7ee-4ae6-8fb7-dbd940243ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6', 'volume_size': 1} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1562617830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9360fa89-f7ee-4ae6-8fb7-dbd940243ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c735f1bb094674ad39205bd0b590eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:17Z,use_quota=True,user_id='f9d46dac7c3e45da9a1aeb4773f7b1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Creating volume 9360fa89-f7ee-4ae6-8fb7-dbd940243ee6 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:44:17 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:44:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:17 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6 1073741824 Jul 08 10:44:17 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:18 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.109s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:18 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:44:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Deleted volume successfully. Jul 08 10:44:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-02ce3005-e6eb-4e13-81f8-659935536c43 tempest-VolumeTypesAccessTest-1662307074 None] Lock "cinder-35d54b1b-1e0d-473f-8a43-b2011313ae1e-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:19 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6 1073741824" returned: 0 in 1.489s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:19 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6 Jul 08 10:44:19 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:20 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6" returned: 0 in 1.042s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] <== create_volume: return (2602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:44:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.605s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdd1c89-48e7-408f-9758-014ce8ad934b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369d8481-b307-4146-8b92-c81209c87ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:20 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Volume volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6 (9360fa89-f7ee-4ae6-8fb7-dbd940243ee6): created successfully Jul 08 10:44:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369d8481-b307-4146-8b92-c81209c87ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Flow 'volume_create_manager' (a1bd49bf-1a3f-4269-b37f-913eb399148a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-33a6fa17-28d5-4dd3-84c5-c539b0bf008a tempest-VolumesListAdminTestJSON-1574809989 None] Created volume successfully. Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Flow 'volume_create_manager' (4b23536a-ee01-4e4b-8242-df0957276732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6932d91-e01f-4862-8180-fbe9ef4eb327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6932d91-e01f-4862-8180-fbe9ef4eb327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1289636864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c735f1bb094674ad39205bd0b590eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:21Z,use_quota=True,user_id='f9d46dac7c3e45da9a1aeb4773f7b1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22d64b2-f8fb-40e6-8666-67ad9b62edc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22d64b2-f8fb-40e6-8666-67ad9b62edc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ce5c50-55fe-454c-a23d-e6ea06e3873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ce5c50-55fe-454c-a23d-e6ea06e3873a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa', 'volume_name': 'volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f00c3c-0c92-4641-b82c-302ac60fd03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f00c3c-0c92-4641-b82c-302ac60fd03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35b3968-451e-4fd9-aca4-ee013f5a0e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:21 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Volume 8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa', 'volume_size': 1} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1289636864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c735f1bb094674ad39205bd0b590eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:21Z,use_quota=True,user_id='f9d46dac7c3e45da9a1aeb4773f7b1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Creating volume 8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:44:21 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:44:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:21 devstack sudo[91979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa 1073741824 Jul 08 10:44:21 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:22 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa 1073741824" returned: 0 in 1.176s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:22 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa Jul 08 10:44:22 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:23 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa" returned: 0 in 0.931s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] <== create_volume: return (2182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:44:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35b3968-451e-4fd9-aca4-ee013f5a0e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958b5e38-1d05-4667-a366-b45e8225c076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:23 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Volume volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa (8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa): created successfully Jul 08 10:44:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958b5e38-1d05-4667-a366-b45e8225c076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Flow 'volume_create_manager' (4b23536a-ee01-4e4b-8242-df0957276732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:23 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1299324c-42dd-4c5d-8e7e-997969626bd2 tempest-VolumesListAdminTestJSON-1574809989 None] Created volume successfully. Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Flow 'volume_create_manager' (b5516504-8714-45d0-b03c-b5227af4e836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426deb6f-6e65-4c16-bc56-51dfc3302a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426deb6f-6e65-4c16-bc56-51dfc3302a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd003ed1-5279-4cbb-b07b-731330774285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c49c07bd1924d1d95d3aa6bc1704d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:26Z,use_quota=True,user_id='a2df5d30a5e24ff39517baa776bd315b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d636feb-1839-481b-9cba-c44be38e27d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d636feb-1839-481b-9cba-c44be38e27d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3665ce77-ecbe-4a16-9f2f-57491acd148c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3665ce77-ecbe-4a16-9f2f-57491acd148c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd003ed1-5279-4cbb-b07b-731330774285', 'volume_name': 'volume-dd003ed1-5279-4cbb-b07b-731330774285', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25dc2eb7-32a6-4108-b252-458173f65ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25dc2eb7-32a6-4108-b252-458173f65ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17cc0c2-5f79-41d6-9bc0-ad6cc7de5fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:26 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Volume dd003ed1-5279-4cbb-b07b-731330774285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd003ed1-5279-4cbb-b07b-731330774285', 'volume_size': 1} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd003ed1-5279-4cbb-b07b-731330774285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c49c07bd1924d1d95d3aa6bc1704d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:26Z,use_quota=True,user_id='a2df5d30a5e24ff39517baa776bd315b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Creating volume dd003ed1-5279-4cbb-b07b-731330774285 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:44:26 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:44:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:26 devstack sudo[91998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285 1073741824 Jul 08 10:44:26 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-1977fe7e-a1c0-4e0f-8653-c22a2f71c244 req-10d6a4de-4029-497a-bed1-89e0db6322d3 tempest-AttachVolumeNegativeTest-1715871990 None] Terminate volume connection completed successfully. Jul 08 10:44:27 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-1977fe7e-a1c0-4e0f-8653-c22a2f71c244 req-10d6a4de-4029-497a-bed1-89e0db6322d3 tempest-AttachVolumeNegativeTest-1715871990 None] Deleting attachment ff419345-592f-43ad-a683-597ad350f697. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:44:27 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285 1073741824" returned: 0 in 1.393s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:27 devstack sudo[92008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285 Jul 08 10:44:27 devstack sudo[92008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:28 devstack sudo[92008]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285" returned: 0 in 0.793s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:44:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17cc0c2-5f79-41d6-9bc0-ad6cc7de5fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd003ed1-5279-4cbb-b07b-731330774285', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8500619f-911a-4489-b46f-b0ba55110f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:28 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Volume volume-dd003ed1-5279-4cbb-b07b-731330774285 (dd003ed1-5279-4cbb-b07b-731330774285): created successfully Jul 08 10:44:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8500619f-911a-4489-b46f-b0ba55110f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Flow 'volume_create_manager' (b5516504-8714-45d0-b03c-b5227af4e836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:28 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-17ae6fad-315f-4f48-b4ca-00c09e663c78 tempest-VolumesListAdminTestJSON-1765058945 None] Created volume successfully. Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Acquiring lock "cinder-dd003ed1-5279-4cbb-b07b-731330774285-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Lock "cinder-dd003ed1-5279-4cbb-b07b-731330774285-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Acquiring lock "cinder-quobyte-dd003ed1-5279-4cbb-b07b-731330774285" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Lock "cinder-quobyte-dd003ed1-5279-4cbb-b07b-731330774285" acquired by "delete_volume" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[552b1776-fa5c-40ef-92a5-c392362558fb]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "cinder-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "cinder-quobyte-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-quobyte-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eb25c7-c2ba-462f-adb9-b73b1efc6954]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:44:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:30 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285 Jul 08 10:44:30 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:30 devstack sudo[92015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa Jul 08 10:44:30 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:31 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285" returned: 0 in 1.469s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:31 devstack sudo[92041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285 Jul 08 10:44:31 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:31 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa" returned: 0 in 1.375s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:31 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa Jul 08 10:44:31 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:33 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa" returned: 0 in 1.200s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-quobyte-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa" released by "delete_volume" :: held 2.648s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:33 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dd003ed1-5279-4cbb-b07b-731330774285" returned: 0 in 1.416s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Lock "cinder-quobyte-dd003ed1-5279-4cbb-b07b-731330774285" released by "delete_volume" :: held 2.965s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Created reservations ['fab5eb42-fdff-4522-9cda-b8eb02449e85', 'd68a936b-70e7-4600-b95c-457c80c50557', '60dddb5d-712a-433a-878a-c82fe42acc43', 'b66b9a75-b4a0-4d0d-ba3d-012047d56f55'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Created reservations ['af975be0-9b9a-4522-920d-60b2997f95a6', '6439683f-d7c0-4f06-8270-017edb665334', '1bd05604-3104-4d24-8f6d-72855a7063ae', '7ade8115-798c-4a53-b19c-4afbc25d72d5'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:33 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:44:33 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:33 devstack sudo[92058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:44:33 devstack sudo[92058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "cinder-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "cinder-quobyte-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-quobyte-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6" acquired by "delete_volume" :: waited 0.046s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:34 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b060ca3a-771c-43d3-8f1d-71ca749b5f87]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:44:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:34 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6 Jul 08 10:44:34 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:34 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.485s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:34 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:44:34 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Deleted volume successfully. Jul 08 10:44:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f7691e0c-e2eb-4a06-8770-d1aee2500ddc tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-8a2bfaa5-1a5b-4b7c-b297-2cab13cf2eaa-delete_volume" released by "delete_volume" :: held 4.676s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:35 devstack sudo[92058]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 2.047s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:35 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:44:35 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Deleted volume successfully. Jul 08 10:44:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-557672e3-8726-4103-8814-4ea6fb2271a5 tempest-VolumesListAdminTestJSON-1765058945 None] Lock "cinder-dd003ed1-5279-4cbb-b07b-731330774285-delete_volume" released by "delete_volume" :: held 5.555s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:35 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6" returned: 0 in 1.671s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:35 devstack sudo[92145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6 Jul 08 10:44:35 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:36 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6" returned: 0 in 0.808s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-quobyte-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6" released by "delete_volume" :: held 2.560s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:36 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Created reservations ['777da8e8-4464-4808-87fc-e5e572759c40', 'f988ba03-02c8-43c4-8462-eb86c536b681', 'ca9b861e-2343-43d8-9490-ab906d47f4f5', 'ca3676e6-01e7-4176-b060-0fe2cfa27acb'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:44:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:36 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:44:36 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "cinder-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "cinder-quobyte-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:37 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.753s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:37 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:44:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-quobyte-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2" acquired by "delete_volume" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:37 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Deleted volume successfully. Jul 08 10:44:37 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[89da0561-28d5-4b02-9191-62df7b56c458]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:44:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3339fd23-ebba-467e-b02d-8141ccb21f16 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-9360fa89-f7ee-4ae6-8fb7-dbd940243ee6-delete_volume" released by "delete_volume" :: held 3.710s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:37 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2 Jul 08 10:44:37 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:38 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2" returned: 0 in 0.876s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:38 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2 Jul 08 10:44:38 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:39 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2" returned: 0 in 0.729s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-quobyte-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2" released by "delete_volume" :: held 1.664s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:39 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Created reservations ['f2a29156-b493-4b2e-9f2b-053230e7cdc7', 'a6c8f977-05fd-4728-bf97-46ea999510b7', 'c3864ad0-b0d0-425e-9dc9-3707d5d67128', 'a8313a4e-cb89-4dcf-893f-d72b079fffc1'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:44:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:39 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:44:39 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:40 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.986s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:40 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:44:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Deleted volume successfully. Jul 08 10:44:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8132be7e-031d-46c0-95df-e73ea66d7053 tempest-VolumesListAdminTestJSON-1574809989 None] Lock "cinder-d8f4eb9b-c121-488a-bc29-f0ddf84a35e2-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=62,cinder:UPDATE=91,cinder:INSERT=20,cinder:DELETE=10 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=77,cinder:UPDATE=97,cinder:INSERT=25,cinder:DELETE=4 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Flow 'volume_create_manager' (b352f6c6-d125-4151-87c1-205c08c14154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a5b158-cc1f-4ca0-960f-b8c2e7719d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a5b158-cc1f-4ca0-960f-b8c2e7719d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1554742924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe03d71-e7e1-417b-9376-46f04232d1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f92082f024e4bfdbf1aca943f2d21d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:46Z,use_quota=True,user_id='940a7857f8e6440b9e1c9e93eada9e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61372849-948d-45d0-84b7-bb3e37eb3db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61372849-948d-45d0-84b7-bb3e37eb3db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ce63a4-2860-4489-82e2-b29b91891957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ce63a4-2860-4489-82e2-b29b91891957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbe03d71-e7e1-417b-9376-46f04232d1b2', 'volume_name': 'volume-fbe03d71-e7e1-417b-9376-46f04232d1b2', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4406b35c-ea26-45d4-9db7-f2f589440630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4406b35c-ea26-45d4-9db7-f2f589440630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c69438-c4b7-4e0b-9113-41a5d1bb64bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:45 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Volume fbe03d71-e7e1-417b-9376-46f04232d1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbe03d71-e7e1-417b-9376-46f04232d1b2', 'volume_size': 1} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1554742924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe03d71-e7e1-417b-9376-46f04232d1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f92082f024e4bfdbf1aca943f2d21d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:44:46Z,use_quota=True,user_id='940a7857f8e6440b9e1c9e93eada9e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Creating volume fbe03d71-e7e1-417b-9376-46f04232d1b2 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:44:45 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:44:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:46 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 1073741824 Jul 08 10:44:46 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:47 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 1073741824" returned: 0 in 1.068s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:47 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 Jul 08 10:44:47 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:47 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2" returned: 0 in 0.776s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:44:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c69438-c4b7-4e0b-9113-41a5d1bb64bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe03d71-e7e1-417b-9376-46f04232d1b2', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c9f58a-7937-40e0-8ce9-521b51c10cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:44:47 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Volume volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 (fbe03d71-e7e1-417b-9376-46f04232d1b2): created successfully Jul 08 10:44:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c9f58a-7937-40e0-8ce9-521b51c10cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:44:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Flow 'volume_create_manager' (b352f6c6-d125-4151-87c1-205c08c14154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:44:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3005f0b3-7e1c-4030-b438-917374c2f1a2 tempest-SnapshotMetadataTestJSON-137193192 None] Created volume successfully. Jul 08 10:44:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] Creating offline snapshot e10377ae-5b34-4427-93f8-ee1aa183bdad of volume fbe03d71-e7e1-417b-9376-46f04232d1b2 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:44:49 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81e5c6b-66bd-4157-8828-5d29d1e9eba4]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:44:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:49 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 Jul 08 10:44:49 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:50 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2" returned: 0 in 1.068s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:50 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad 1G Jul 08 10:44:50 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-3c117ff2-1a45-4d6c-8594-354ab9da643f req-b2d9cd4b-cd6e-4601-aa5a-57ca8478ab78 tempest-ServerActionsTestOtherA-1358319655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:51 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad 1G" returned: 0 in 1.155s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:51 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad Jul 08 10:44:51 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:52 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad" returned: 0 in 0.726s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:52 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad is being set with open permissions: ugo+rw Jul 08 10:44:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:52 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad Jul 08 10:44:52 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:53 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad" returned: 0 in 0.744s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:53 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.info Jul 08 10:44:53 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:53 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.info" returned: 0 in 0.653s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:53 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.info is being set with open permissions: ugo+rw Jul 08 10:44:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:53 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.info Jul 08 10:44:53 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:44:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:44:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:44:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:44:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:53 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:44:53 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:54 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.868s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:44:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:44:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 8 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:44:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:44:54 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.info" returned: 0 in 1.030s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.515s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-3c117ff2-1a45-4d6c-8594-354ab9da643f req-b2d9cd4b-cd6e-4601-aa5a-57ca8478ab78 tempest-ServerActionsTestOtherA-1358319655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.580s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:44:54 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea47928-c8c4-4f4a-be9d-351b023514f5]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:44:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-3c117ff2-1a45-4d6c-8594-354ab9da643f req-b2d9cd4b-cd6e-4601-aa5a-57ca8478ab78 tempest-ServerActionsTestOtherA-1358319655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:54 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f689fa79-0c51-4a46-ba91-89d2087157fe tempest-SnapshotMetadataTestJSON-137193192 None] Create snapshot completed successfully Jul 08 10:44:55 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 Jul 08 10:44:55 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:55 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-3c117ff2-1a45-4d6c-8594-354ab9da643f req-b2d9cd4b-cd6e-4601-aa5a-57ca8478ab78 tempest-ServerActionsTestOtherA-1358319655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80" returned: 0 in 1.012s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-3c117ff2-1a45-4d6c-8594-354ab9da643f req-b2d9cd4b-cd6e-4601-aa5a-57ca8478ab78 tempest-ServerActionsTestOtherA-1358319655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.038s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:44:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-3c117ff2-1a45-4d6c-8594-354ab9da643f req-b2d9cd4b-cd6e-4601-aa5a-57ca8478ab78 tempest-ServerActionsTestOtherA-1358319655 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-3735fd07-f29a-472d-8d86-9e216ce31b80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a300e130-45c8-4346-8569-a9c8e44421cb', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:44:56 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-3c117ff2-1a45-4d6c-8594-354ab9da643f req-b2d9cd4b-cd6e-4601-aa5a-57ca8478ab78 tempest-ServerActionsTestOtherA-1358319655 None] attachment_update completed successfully. Jul 08 10:44:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Acquiring lock "cinder-e10377ae-5b34-4427-93f8-ee1aa183bdad-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Lock "cinder-e10377ae-5b34-4427-93f8-ee1aa183bdad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Acquiring lock "cinder-quobyte-fbe03d71-e7e1-417b-9376-46f04232d1b2" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Lock "cinder-quobyte-fbe03d71-e7e1-417b-9376-46f04232d1b2" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Acquiring lock "cinder-quobyte-e10377ae-5b34-4427-93f8-ee1aa183bdad" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:44:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Lock "cinder-quobyte-e10377ae-5b34-4427-93f8-ee1aa183bdad" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:44:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Deleting offline snapshot e10377ae-5b34-4427-93f8-ee1aa183bdad of volume fbe03d71-e7e1-417b-9376-46f04232d1b2 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:44:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] snapshot_file for this snap is: volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:44:56 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f827ba90-c4f3-4b7d-8a6a-040651a5435f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:44:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:57 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad Jul 08 10:44:57 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:58 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad" returned: 0 in 1.269s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbe03d71-e7e1-417b-9376-46f04232d1b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:44:58 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ddffce-4c3c-4fe5-a17c-8e562b34aad6]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:44:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:58 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 Jul 08 10:44:58 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:44:59 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Jul 08 10:44:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2" returned: 0 in 0.863s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:44:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:44:59 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad Jul 08 10:44:59 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:00 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad" returned: 0 in 1.148s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:00 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad Jul 08 10:45:00 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:01 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2.e10377ae-5b34-4427-93f8-ee1aa183bdad" returned: 0 in 0.876s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Lock "cinder-quobyte-e10377ae-5b34-4427-93f8-ee1aa183bdad" released by "_delete_snapshot" :: held 4.338s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Lock "cinder-quobyte-fbe03d71-e7e1-417b-9376-46f04232d1b2" released by "delete_snapshot" :: held 4.378s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:01 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Created reservations ['b21c61e6-cce9-42f6-afbb-71901efb11b5', '90e104b8-7696-435e-88c7-5fdb2164b583', '98e0793a-7695-4f9e-a526-3e38708603e1', 'da163622-98e4-425b-a274-a14cb0eb7a2b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:45:01 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Delete snapshot completed successfully. Jul 08 10:45:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c5417090-395a-4ae4-bcee-2f620a709d65 tempest-SnapshotMetadataTestJSON-137193192 None] Lock "cinder-e10377ae-5b34-4427-93f8-ee1aa183bdad-delete_snapshot" released by "delete_snapshot" :: held 4.694s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Acquiring lock "cinder-fbe03d71-e7e1-417b-9376-46f04232d1b2-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:45:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Lock "cinder-fbe03d71-e7e1-417b-9376-46f04232d1b2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:45:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Acquiring lock "cinder-quobyte-fbe03d71-e7e1-417b-9376-46f04232d1b2" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:45:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Lock "cinder-quobyte-fbe03d71-e7e1-417b-9376-46f04232d1b2" acquired by "delete_volume" :: waited 0.035s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:45:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c196b07c-f183-4a3f-8116-be3a4eb7f183]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:45:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:02 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 Jul 08 10:45:02 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:03 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2" returned: 0 in 1.125s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:03 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2 Jul 08 10:45:03 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:04 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fbe03d71-e7e1-417b-9376-46f04232d1b2" returned: 0 in 1.145s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Lock "cinder-quobyte-fbe03d71-e7e1-417b-9376-46f04232d1b2" released by "delete_volume" :: held 2.406s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:05 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Created reservations ['07336817-44d6-435f-b0ce-62b14f95f4a3', 'd9f71a06-e919-4465-af2f-90e6ded95622', 'c6cd4982-7fff-4b76-bbac-1df76a069f4e', '8a40ff78-65b1-42cc-8629-b70ce997b94a'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:45:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:45:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:45:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:45:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:45:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:45:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:05 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:45:05 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-ea0a1a6a-992c-4e6f-8eab-e12bbef15d54 req-6454eb3e-8fd2-4882-a043-7fa6fd584109 tempest-ServerActionsTestOtherA-1358319655 None] Terminate volume connection completed successfully. Jul 08 10:45:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-ea0a1a6a-992c-4e6f-8eab-e12bbef15d54 req-6454eb3e-8fd2-4882-a043-7fa6fd584109 tempest-ServerActionsTestOtherA-1358319655 None] Deleting attachment a300e130-45c8-4346-8569-a9c8e44421cb. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:45:06 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.091s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:06 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:45:06 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Deleted volume successfully. Jul 08 10:45:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc4f00db-c3d9-45b8-a768-0110d451b81d tempest-SnapshotMetadataTestJSON-137193192 None] Lock "cinder-fbe03d71-e7e1-417b-9376-46f04232d1b2-delete_volume" released by "delete_volume" :: held 4.038s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-ea0a1a6a-992c-4e6f-8eab-e12bbef15d54 req-d32da59d-c824-4fcf-a53f-fd4d6d8c10f2 tempest-ServerActionsTestOtherA-1358319655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:45:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-ea0a1a6a-992c-4e6f-8eab-e12bbef15d54 req-d32da59d-c824-4fcf-a53f-fd4d6d8c10f2 tempest-ServerActionsTestOtherA-1358319655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:45:08 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[927c7456-c3cb-4d1e-a8a0-9f5646d04747]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:45:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-ea0a1a6a-992c-4e6f-8eab-e12bbef15d54 req-d32da59d-c824-4fcf-a53f-fd4d6d8c10f2 tempest-ServerActionsTestOtherA-1358319655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:08 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 Jul 08 10:45:08 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:09 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-ea0a1a6a-992c-4e6f-8eab-e12bbef15d54 req-d32da59d-c824-4fcf-a53f-fd4d6d8c10f2 tempest-ServerActionsTestOtherA-1358319655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80" returned: 0 in 1.235s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-ea0a1a6a-992c-4e6f-8eab-e12bbef15d54 req-d32da59d-c824-4fcf-a53f-fd4d6d8c10f2 tempest-ServerActionsTestOtherA-1358319655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.268s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:45:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-ea0a1a6a-992c-4e6f-8eab-e12bbef15d54 req-d32da59d-c824-4fcf-a53f-fd4d6d8c10f2 tempest-ServerActionsTestOtherA-1358319655 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-3735fd07-f29a-472d-8d86-9e216ce31b80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1aa0bde9-56b1-41e8-a861-b4bf30ec8888', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:45:10 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-ea0a1a6a-992c-4e6f-8eab-e12bbef15d54 req-d32da59d-c824-4fcf-a53f-fd4d6d8c10f2 tempest-ServerActionsTestOtherA-1358319655 None] attachment_update completed successfully. Jul 08 10:45:20 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=25,cinder:SELECT=29,cinder:INSERT=5 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:45:20 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=26,cinder:INSERT=5,cinder:UPDATE=16,cinder:DELETE=3 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Flow 'volume_create_manager' (cf034bdc-1d03-4c31-a613-6438faf2721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2d2570-558e-4b3a-8f85-f1e9f784e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2d2570-558e-4b3a-8f85-f1e9f784e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835986702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d882fa-a2f5-41b2-83c5-65c996227917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5836cd8c9caa4bc39c1fe73c3e0368a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:45:25Z,use_quota=True,user_id='a9d6507d6b8144dfb8595903d026e713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9bae99-aa83-46dd-9b70-1141a492cb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9bae99-aa83-46dd-9b70-1141a492cb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc1cf92-1a41-458f-b549-7bcc0bee05b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc1cf92-1a41-458f-b549-7bcc0bee05b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d882fa-a2f5-41b2-83c5-65c996227917', 'volume_name': 'volume-43d882fa-a2f5-41b2-83c5-65c996227917', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd5f08a-0225-491d-b163-7e0773f45937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd5f08a-0225-491d-b163-7e0773f45937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5c94bb-3f2f-471d-9fbc-760a218fabb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:25 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Volume 43d882fa-a2f5-41b2-83c5-65c996227917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d882fa-a2f5-41b2-83c5-65c996227917', 'volume_size': 1} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835986702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d882fa-a2f5-41b2-83c5-65c996227917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5836cd8c9caa4bc39c1fe73c3e0368a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:45:25Z,use_quota=True,user_id='a9d6507d6b8144dfb8595903d026e713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Creating volume 43d882fa-a2f5-41b2-83c5-65c996227917 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:45:25 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:45:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:25 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917 1073741824 Jul 08 10:45:25 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:26 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917 1073741824" returned: 0 in 1.123s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:26 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917 Jul 08 10:45:26 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:27 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917" returned: 0 in 0.989s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] <== create_volume: return (2187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:45:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.190s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:45:27 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5c94bb-3f2f-471d-9fbc-760a218fabb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d882fa-a2f5-41b2-83c5-65c996227917', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:27 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12f3048-3268-47e3-accf-4ecdf39705f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:27 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Volume volume-43d882fa-a2f5-41b2-83c5-65c996227917 (43d882fa-a2f5-41b2-83c5-65c996227917): created successfully Jul 08 10:45:27 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12f3048-3268-47e3-accf-4ecdf39705f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:27 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Flow 'volume_create_manager' (cf034bdc-1d03-4c31-a613-6438faf2721e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:45:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9b99b981-a883-4c97-b618-3da6f53d37d2 tempest-AttachVolumeNegativeTest-1715871990 None] Created volume successfully. Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Flow 'volume_create_manager' (264cac62-3c9e-43da-970a-4cc3115ac954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27633063-a56a-4611-8622-0e04d2be237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27633063-a56a-4611-8622-0e04d2be237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1568102880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e2c966-a10c-4212-8faf-cf9087e7f877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bf1dd3bbe948be8e14308720655b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:45:31Z,use_quota=True,user_id='d5aa77a7cc9f4f608f8f3211e417cc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83ab852-4098-4082-85e5-9aa341114e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83ab852-4098-4082-85e5-9aa341114e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752194c6-5299-43c9-bd0d-5d2dd91cb0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752194c6-5299-43c9-bd0d-5d2dd91cb0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e2c966-a10c-4212-8faf-cf9087e7f877', 'volume_name': 'volume-88e2c966-a10c-4212-8faf-cf9087e7f877', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b242e167-2857-4825-b1c6-419eb0694df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b242e167-2857-4825-b1c6-419eb0694df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896c2eea-289b-4118-b037-972965d64640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:30 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Volume 88e2c966-a10c-4212-8faf-cf9087e7f877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e2c966-a10c-4212-8faf-cf9087e7f877', 'volume_size': 1} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1568102880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e2c966-a10c-4212-8faf-cf9087e7f877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bf1dd3bbe948be8e14308720655b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:45:31Z,use_quota=True,user_id='d5aa77a7cc9f4f608f8f3211e417cc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Creating volume 88e2c966-a10c-4212-8faf-cf9087e7f877 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:45:30 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:45:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:30 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 1073741824 Jul 08 10:45:30 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:31 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 1073741824" returned: 0 in 1.038s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:31 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 Jul 08 10:45:31 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-2ecbff96-149f-4d4b-b4bc-7021ac7abe72 req-00864914-451b-4135-931f-658c584a854f tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:45:32 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877" returned: 0 in 0.682s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:45:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:45:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-2ecbff96-149f-4d4b-b4bc-7021ac7abe72 req-00864914-451b-4135-931f-658c584a854f tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.307s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:45:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896c2eea-289b-4118-b037-972965d64640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e2c966-a10c-4212-8faf-cf9087e7f877', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c38b0b-ae1f-445d-b4f9-975e97316a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:32 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09f1e23-88d9-4407-8f2a-7db332d7be2e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:45:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-2ecbff96-149f-4d4b-b4bc-7021ac7abe72 req-00864914-451b-4135-931f-658c584a854f tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:32 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Volume volume-88e2c966-a10c-4212-8faf-cf9087e7f877 (88e2c966-a10c-4212-8faf-cf9087e7f877): created successfully Jul 08 10:45:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c38b0b-ae1f-445d-b4f9-975e97316a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Flow 'volume_create_manager' (264cac62-3c9e-43da-970a-4cc3115ac954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:45:32 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-29bc2fe4-8858-4922-ab37-d4ba78f27669 tempest-VolumesActionsTest-255004225 None] Created volume successfully. Jul 08 10:45:32 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917 Jul 08 10:45:32 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:33 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-2ecbff96-149f-4d4b-b4bc-7021ac7abe72 req-00864914-451b-4135-931f-658c584a854f tempest-AttachVolumeNegativeTest-1715871990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917" returned: 0 in 0.770s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-2ecbff96-149f-4d4b-b4bc-7021ac7abe72 req-00864914-451b-4135-931f-658c584a854f tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.800s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:45:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-2ecbff96-149f-4d4b-b4bc-7021ac7abe72 req-00864914-451b-4135-931f-658c584a854f tempest-AttachVolumeNegativeTest-1715871990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-43d882fa-a2f5-41b2-83c5-65c996227917', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7debeca-52fa-4d23-a9dc-aaa6a5bafc82', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:45:33 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-2ecbff96-149f-4d4b-b4bc-7021ac7abe72 req-00864914-451b-4135-931f-658c584a854f tempest-AttachVolumeNegativeTest-1715871990 None] attachment_update completed successfully. Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (20c41472-99b8-4cba-8089-6515774cfa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f0446e-20a6-429b-bb45-5a6bff7cb2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f0446e-20a6-429b-bb45-5a6bff7cb2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-710646080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15b148d-0d32-4d8e-8d4b-7496658d2015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:45:40Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc445cf4-5f8b-4a68-9187-2e2d5f4e8520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc445cf4-5f8b-4a68-9187-2e2d5f4e8520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f21e219-171e-4c23-84db-03811016c131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f21e219-171e-4c23-84db-03811016c131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15b148d-0d32-4d8e-8d4b-7496658d2015', 'volume_name': 'volume-b15b148d-0d32-4d8e-8d4b-7496658d2015', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f62969e-d2e8-404e-bdb4-a2acc7c09bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f62969e-d2e8-404e-bdb4-a2acc7c09bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eab1016-9bd4-49e8-b40c-acd177d2d0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:40 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Volume b15b148d-0d32-4d8e-8d4b-7496658d2015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15b148d-0d32-4d8e-8d4b-7496658d2015', 'volume_size': 1} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-710646080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15b148d-0d32-4d8e-8d4b-7496658d2015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:45:40Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Creating volume b15b148d-0d32-4d8e-8d4b-7496658d2015 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:45:40 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:45:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:40 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015 1073741824 Jul 08 10:45:40 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:41 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-b5c8cd65-edc5-4ce7-bd36-42737721ca84 req-cb2f2ddb-4fb8-46cb-98df-ad6ec0d6dcc9 tempest-AttachVolumeNegativeTest-1715871990 None] Terminate volume connection completed successfully. Jul 08 10:45:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-b5c8cd65-edc5-4ce7-bd36-42737721ca84 req-cb2f2ddb-4fb8-46cb-98df-ad6ec0d6dcc9 tempest-AttachVolumeNegativeTest-1715871990 None] Deleting attachment c7debeca-52fa-4d23-a9dc-aaa6a5bafc82. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:45:41 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015 1073741824" returned: 0 in 1.260s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:41 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015 Jul 08 10:45:41 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:42 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015" returned: 0 in 0.683s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:45:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:45:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eab1016-9bd4-49e8-b40c-acd177d2d0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15b148d-0d32-4d8e-8d4b-7496658d2015', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451e88ab-011d-4abb-bc72-99b8b4872958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:45:42 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Volume volume-b15b148d-0d32-4d8e-8d4b-7496658d2015 (b15b148d-0d32-4d8e-8d4b-7496658d2015): created successfully Jul 08 10:45:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451e88ab-011d-4abb-bc72-99b8b4872958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:45:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (20c41472-99b8-4cba-8089-6515774cfa22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:45:42 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d3dcc320-0d32-4b39-83d7-573de6625100 tempest-VolumesActionsTest-1489807610 None] Created volume successfully. Jul 08 10:45:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-936cd1ed-3e0b-45a1-99bf-b4a12d3ebbce tempest-VolumesActionsTest-1489807610 None] Acquiring lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015" by "attach_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:45:43 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-21db76c8-f21c-40c9-99fa-1ead4a7a73be req-282a121c-cec1-492a-9bbe-97c6b00a783c tempest-ServerActionsTestOtherA-1358319655 None] Terminate volume connection completed successfully. Jul 08 10:45:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-21db76c8-f21c-40c9-99fa-1ead4a7a73be req-282a121c-cec1-492a-9bbe-97c6b00a783c tempest-ServerActionsTestOtherA-1358319655 None] Deleting attachment 1aa0bde9-56b1-41e8-a861-b4bf30ec8888. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:45:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-936cd1ed-3e0b-45a1-99bf-b4a12d3ebbce tempest-VolumesActionsTest-1489807610 None] Lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015" acquired by "attach_volume" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:45:43 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-936cd1ed-3e0b-45a1-99bf-b4a12d3ebbce tempest-VolumesActionsTest-1489807610 None] Attaching volume b15b148d-0d32-4d8e-8d4b-7496658d2015 to instance df793f94-d89f-40f0-9039-cfa518ad67d8 at mountpoint /dev/vdb on host None. Jul 08 10:45:43 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-936cd1ed-3e0b-45a1-99bf-b4a12d3ebbce tempest-VolumesActionsTest-1489807610 None] Attach volume completed successfully. Jul 08 10:45:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-936cd1ed-3e0b-45a1-99bf-b4a12d3ebbce tempest-VolumesActionsTest-1489807610 None] Lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015" released by "attach_volume" :: held 0.115s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:44 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-63572278-a065-46b8-b3de-f7ff4e91a03d tempest-VolumesActionsTest-27091715 None] Terminate volume connection completed successfully. Jul 08 10:45:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-63572278-a065-46b8-b3de-f7ff4e91a03d tempest-VolumesActionsTest-27091715 None] Acquiring lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015-detach_volume" by "detach_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:45:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-63572278-a065-46b8-b3de-f7ff4e91a03d tempest-VolumesActionsTest-27091715 None] Lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:45:45 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-63572278-a065-46b8-b3de-f7ff4e91a03d tempest-VolumesActionsTest-27091715 None] Detaching volume b15b148d-0d32-4d8e-8d4b-7496658d2015 from instance df793f94-d89f-40f0-9039-cfa518ad67d8. Jul 08 10:45:45 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-63572278-a065-46b8-b3de-f7ff4e91a03d tempest-VolumesActionsTest-27091715 None] Detach volume completed successfully. Jul 08 10:45:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-63572278-a065-46b8-b3de-f7ff4e91a03d tempest-VolumesActionsTest-27091715 None] Lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015-detach_volume" released by "detach_volume" :: held 0.354s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0c92ef7b-87a9-4015-8b4b-208021fd4325 tempest-VolumesActionsTest-1489807610 None] Acquiring lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015-detach_volume" by "detach_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:45:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0c92ef7b-87a9-4015-8b4b-208021fd4325 tempest-VolumesActionsTest-1489807610 None] Lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:45:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0c92ef7b-87a9-4015-8b4b-208021fd4325 tempest-VolumesActionsTest-1489807610 None] Volume detach called, but volume not attached. Jul 08 10:45:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0c92ef7b-87a9-4015-8b4b-208021fd4325 tempest-VolumesActionsTest-1489807610 None] Lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015-detach_volume" released by "detach_volume" :: held 0.061s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Acquiring lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:45:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:45:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Acquiring lock "cinder-quobyte-b15b148d-0d32-4d8e-8d4b-7496658d2015" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:45:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Lock "cinder-quobyte-b15b148d-0d32-4d8e-8d4b-7496658d2015" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:45:47 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a783e848-99cb-4137-ae43-057a3ebf47c6]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:45:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:47 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015 Jul 08 10:45:47 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:49 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015" returned: 0 in 2.115s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:49 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015 Jul 08 10:45:49 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:51 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b15b148d-0d32-4d8e-8d4b-7496658d2015" returned: 0 in 1.597s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Lock "cinder-quobyte-b15b148d-0d32-4d8e-8d4b-7496658d2015" released by "delete_volume" :: held 3.852s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:51 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Created reservations ['02b6545b-3077-4486-97f6-e34527fdc693', '5441b02e-ee41-4c2b-8c3a-c0df960c3629', 'af832607-fa04-4cf8-90fe-93fb4b93ebce', 'e9a9e051-7453-4474-ab1e-f9084359f34a'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:45:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:45:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:45:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:45:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:45:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:45:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:51 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:45:51 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-80392cbf-dce1-49ee-8fa9-2cfa80fd22c7 tempest-VolumesActionsTest-255004225 None] Acquiring lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877" by "attach_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:45:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-80392cbf-dce1-49ee-8fa9-2cfa80fd22c7 tempest-VolumesActionsTest-255004225 None] Lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877" acquired by "attach_volume" :: waited 0.041s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:45:52 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.294s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:52 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:45:52 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Deleted volume successfully. Jul 08 10:45:52 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-80392cbf-dce1-49ee-8fa9-2cfa80fd22c7 tempest-VolumesActionsTest-255004225 None] Attaching volume 88e2c966-a10c-4212-8faf-cf9087e7f877 to instance bcbf8202-40b4-4f5b-bca6-2d0e734b12ea at mountpoint /dev/vdb on host None. Jul 08 10:45:52 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-80392cbf-dce1-49ee-8fa9-2cfa80fd22c7 tempest-VolumesActionsTest-255004225 None] Attach volume completed successfully. Jul 08 10:45:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-75bbc58c-050f-4c86-9960-40efa4013116 tempest-VolumesActionsTest-1489807610 None] Lock "cinder-b15b148d-0d32-4d8e-8d4b-7496658d2015-delete_volume" released by "delete_volume" :: held 5.470s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-80392cbf-dce1-49ee-8fa9-2cfa80fd22c7 tempest-VolumesActionsTest-255004225 None] Lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877" released by "attach_volume" :: held 0.199s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a53b0d9a-0368-4fe8-8b76-3864887684a4 tempest-VolumesActionsTest-255004225 None] Acquiring lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877-detach_volume" by "detach_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:45:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a53b0d9a-0368-4fe8-8b76-3864887684a4 tempest-VolumesActionsTest-255004225 None] Lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:45:53 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a53b0d9a-0368-4fe8-8b76-3864887684a4 tempest-VolumesActionsTest-255004225 None] Detaching volume 88e2c966-a10c-4212-8faf-cf9087e7f877 from instance bcbf8202-40b4-4f5b-bca6-2d0e734b12ea. Jul 08 10:45:53 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a53b0d9a-0368-4fe8-8b76-3864887684a4 tempest-VolumesActionsTest-255004225 None] Detach volume completed successfully. Jul 08 10:45:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a53b0d9a-0368-4fe8-8b76-3864887684a4 tempest-VolumesActionsTest-255004225 None] Lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:45:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:45:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:45:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:45:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:45:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:45:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:45:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:53 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:45:53 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:55 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.323s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:55 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:45:55 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:45:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 8 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:45:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:45:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Acquiring lock "cinder-3735fd07-f29a-472d-8d86-9e216ce31b80-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:45:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Lock "cinder-3735fd07-f29a-472d-8d86-9e216ce31b80-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:45:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Acquiring lock "cinder-quobyte-3735fd07-f29a-472d-8d86-9e216ce31b80" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:45:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Lock "cinder-quobyte-3735fd07-f29a-472d-8d86-9e216ce31b80" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:45:58 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6535c0ab-791f-4555-94c4-f2852c1ec48c]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:45:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:58 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 Jul 08 10:45:58 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:59 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80" returned: 0 in 0.931s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:45:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:45:59 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80 Jul 08 10:45:59 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:45:59 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jul 08 10:45:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3735fd07-f29a-472d-8d86-9e216ce31b80" returned: 0 in 0.809s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Lock "cinder-quobyte-3735fd07-f29a-472d-8d86-9e216ce31b80" released by "delete_volume" :: held 1.790s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:00 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Created reservations ['75a60d53-a89d-4495-b801-0f620f5175a9', 'cfc8045f-7e14-4fe5-9525-02c60aba26bf', 'fcbb5265-e51a-410a-9d66-0a017adee2d0', '8748f34c-2a09-405e-95f8-605e80803919'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:46:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:00 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:46:00 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:01 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.893s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:46:01 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Deleted volume successfully. Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-abe18c97-9c5e-4d6a-9810-bee324d0a90f tempest-ServerActionsTestOtherA-1358319655 None] Lock "cinder-3735fd07-f29a-472d-8d86-9e216ce31b80-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (ab75960c-d4ff-430d-bff0-39fa2d164a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cff25c4-0397-47c2-b2c9-75e69a5d326c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cff25c4-0397-47c2-b2c9-75e69a5d326c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10289543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feff18df-b414-4f67-a24e-6bcbb0c068eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:01Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2f8697-b6f7-412d-95a7-e36601ae29c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2f8697-b6f7-412d-95a7-e36601ae29c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bf5512-f0ae-477d-b958-a36e4e7ed378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bf5512-f0ae-477d-b958-a36e4e7ed378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feff18df-b414-4f67-a24e-6bcbb0c068eb', 'volume_name': 'volume-feff18df-b414-4f67-a24e-6bcbb0c068eb', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988a1fd2-372c-4494-941b-c91525d360bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988a1fd2-372c-4494-941b-c91525d360bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b97322-e9c8-4563-b099-0a205ef11d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:01 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Volume feff18df-b414-4f67-a24e-6bcbb0c068eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feff18df-b414-4f67-a24e-6bcbb0c068eb', 'volume_size': 1} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10289543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feff18df-b414-4f67-a24e-6bcbb0c068eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:01Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Creating volume feff18df-b414-4f67-a24e-6bcbb0c068eb {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:46:01 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:46:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:01 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb 1073741824 Jul 08 10:46:01 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:02 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb 1073741824" returned: 0 in 1.032s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:02 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb Jul 08 10:46:02 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:03 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb" returned: 0 in 0.861s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:46:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b97322-e9c8-4563-b099-0a205ef11d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feff18df-b414-4f67-a24e-6bcbb0c068eb', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc04251a-bee8-4d23-8016-eb531704dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:03 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Volume volume-feff18df-b414-4f67-a24e-6bcbb0c068eb (feff18df-b414-4f67-a24e-6bcbb0c068eb): created successfully Jul 08 10:46:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc04251a-bee8-4d23-8016-eb531704dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (ab75960c-d4ff-430d-bff0-39fa2d164a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:03 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-54856fd7-3e03-43ea-b70c-56184178947e tempest-VolumesActionsTest-1489807610 None] Created volume successfully. Jul 08 10:46:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Acquiring lock "cinder-feff18df-b414-4f67-a24e-6bcbb0c068eb-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Lock "cinder-feff18df-b414-4f67-a24e-6bcbb0c068eb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Acquiring lock "cinder-quobyte-feff18df-b414-4f67-a24e-6bcbb0c068eb" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Lock "cinder-quobyte-feff18df-b414-4f67-a24e-6bcbb0c068eb" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:04 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b033af69-c8c5-4043-af89-23eacfbec3ad]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:46:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:04 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb Jul 08 10:46:04 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:05 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb" returned: 0 in 1.048s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:05 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb Jul 08 10:46:05 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:06 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-feff18df-b414-4f67-a24e-6bcbb0c068eb" returned: 0 in 0.712s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Lock "cinder-quobyte-feff18df-b414-4f67-a24e-6bcbb0c068eb" released by "delete_volume" :: held 1.810s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:06 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Created reservations ['406d4b6b-5f21-4b5e-b697-41e689adca6b', 'eba0983c-f583-4e1f-a826-fd3ebe0abb67', '2013f329-89ce-4168-9895-0a29652cba7e', 'fab2b4c9-6cc2-4293-b059-d02764c41575'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:46:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:06 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:46:06 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:46:07 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (a99ff9a6-0353-4935-91cb-138e95988033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c679218-2df8-4ae2-a822-736e796bce36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.964s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:46:07 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Deleted volume successfully. Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c679218-2df8-4ae2-a822-736e796bce36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-896682630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd95d6a-c28b-4629-a7c1-d764bacf7989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:08Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8766d7b-afb3-4f90-8071-757c4fbc937a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8766d7b-afb3-4f90-8071-757c4fbc937a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e537fca-fe64-4366-a838-65b125f260a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e537fca-fe64-4366-a838-65b125f260a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd95d6a-c28b-4629-a7c1-d764bacf7989', 'volume_name': 'volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73de5b20-65fc-4d7a-b5f3-555de79efd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73de5b20-65fc-4d7a-b5f3-555de79efd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94a92ca-7173-465a-b857-b7ed8f771562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:07 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Volume 9cd95d6a-c28b-4629-a7c1-d764bacf7989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989', 'volume_size': 1} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-896682630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd95d6a-c28b-4629-a7c1-d764bacf7989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:08Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Creating volume 9cd95d6a-c28b-4629-a7c1-d764bacf7989 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:46:07 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:07 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989 1073741824 Jul 08 10:46:07 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-35050666-b87f-4086-a6bd-6b977bf4d3e9 tempest-VolumesActionsTest-27091715 None] Lock "cinder-feff18df-b414-4f67-a24e-6bcbb0c068eb-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:08 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989 1073741824" returned: 0 in 1.012s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:08 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989 Jul 08 10:46:08 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:09 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989" returned: 0 in 0.921s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:46:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94a92ca-7173-465a-b857-b7ed8f771562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90a8eae-4d11-46e3-be28-666122603c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:09 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Volume volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989 (9cd95d6a-c28b-4629-a7c1-d764bacf7989): created successfully Jul 08 10:46:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90a8eae-4d11-46e3-be28-666122603c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (a99ff9a6-0353-4935-91cb-138e95988033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-88a6e124-2b39-47c5-9e0e-45fa80efd848 tempest-VolumesActionsTest-1489807610 None] Created volume successfully. Jul 08 10:46:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Acquiring lock "cinder-9cd95d6a-c28b-4629-a7c1-d764bacf7989-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Lock "cinder-9cd95d6a-c28b-4629-a7c1-d764bacf7989-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Acquiring lock "cinder-quobyte-9cd95d6a-c28b-4629-a7c1-d764bacf7989" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Lock "cinder-quobyte-9cd95d6a-c28b-4629-a7c1-d764bacf7989" acquired by "delete_volume" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:10 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91f5903-d252-4fa6-97b6-c06045610cd1]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:46:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:11 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989 Jul 08 10:46:11 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:12 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989" returned: 0 in 1.176s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:12 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989 Jul 08 10:46:12 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:13 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9cd95d6a-c28b-4629-a7c1-d764bacf7989" returned: 0 in 0.886s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Lock "cinder-quobyte-9cd95d6a-c28b-4629-a7c1-d764bacf7989" released by "delete_volume" :: held 2.121s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:13 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Created reservations ['2b3ac148-8708-46b2-ba21-07a5ab11f053', '82da50d3-8112-46bf-8c79-f39a7d91533f', 'b31f7f11-12f6-49f3-ab74-cbbeb9f8c686', 'df00cc3a-b59c-4811-89ed-153c139ca70b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:46:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:13 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:46:13 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:14 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.824s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:14 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:46:14 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Deleted volume successfully. Jul 08 10:46:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4912c5cc-5405-4048-b00a-f59f76f63c81 tempest-VolumesActionsTest-27091715 None] Lock "cinder-9cd95d6a-c28b-4629-a7c1-d764bacf7989-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (7da5120f-f9bc-4eca-ab20-be97761d33cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6428ee41-9483-45c7-ba3e-543b5e7a7eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6428ee41-9483-45c7-ba3e-543b5e7a7eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1797692293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0313a95e-a7a9-4e36-8255-d64f94106fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:16Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a7c989-41fd-4cb7-aa24-76bcec99445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a7c989-41fd-4cb7-aa24-76bcec99445f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de2d7a5-515e-494f-ad06-96a11a59e427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de2d7a5-515e-494f-ad06-96a11a59e427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0313a95e-a7a9-4e36-8255-d64f94106fc7', 'volume_name': 'volume-0313a95e-a7a9-4e36-8255-d64f94106fc7', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c3766d-ab31-4eee-8a70-d12c5cf6c588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c3766d-ab31-4eee-8a70-d12c5cf6c588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aacc10-c935-4348-a69d-b1cfb737abef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:15 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Volume 0313a95e-a7a9-4e36-8255-d64f94106fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0313a95e-a7a9-4e36-8255-d64f94106fc7', 'volume_size': 1} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1797692293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0313a95e-a7a9-4e36-8255-d64f94106fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:16Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Creating volume 0313a95e-a7a9-4e36-8255-d64f94106fc7 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:46:15 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:46:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:15 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7 1073741824 Jul 08 10:46:15 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:17 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7 1073741824" returned: 0 in 1.668s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:17 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7 Jul 08 10:46:17 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:19 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7" returned: 0 in 1.602s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] <== create_volume: return (3393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:46:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.399s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aacc10-c935-4348-a69d-b1cfb737abef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0313a95e-a7a9-4e36-8255-d64f94106fc7', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e422e090-794d-4905-b480-6b93d37a734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:19 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Volume volume-0313a95e-a7a9-4e36-8255-d64f94106fc7 (0313a95e-a7a9-4e36-8255-d64f94106fc7): created successfully Jul 08 10:46:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e422e090-794d-4905-b480-6b93d37a734d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (7da5120f-f9bc-4eca-ab20-be97761d33cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:19 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b520bdfa-82fd-44a5-ac0e-697b032ce361 tempest-VolumesActionsTest-1489807610 None] Created volume successfully. Jul 08 10:46:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Acquiring lock "cinder-0313a95e-a7a9-4e36-8255-d64f94106fc7-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Lock "cinder-0313a95e-a7a9-4e36-8255-d64f94106fc7-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:20 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=52,cinder:UPDATE=60,cinder:INSERT=14,cinder:DELETE=8 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:46:20 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=57,cinder:UPDATE=58,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:46:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Acquiring lock "cinder-quobyte-0313a95e-a7a9-4e36-8255-d64f94106fc7" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Lock "cinder-quobyte-0313a95e-a7a9-4e36-8255-d64f94106fc7" acquired by "delete_volume" :: waited 0.036s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:20 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5119e0b-c627-43d9-a612-b130e130fa0f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:46:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:21 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7 Jul 08 10:46:21 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-33d375fe-9d22-4772-9b55-8108761d79d8 tempest-VolumesActionsTest-255004225 None] Acquiring lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877" by "attach_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-33d375fe-9d22-4772-9b55-8108761d79d8 tempest-VolumesActionsTest-255004225 None] Lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877" acquired by "attach_volume" :: waited 0.060s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:21 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-33d375fe-9d22-4772-9b55-8108761d79d8 tempest-VolumesActionsTest-255004225 None] Attaching volume 88e2c966-a10c-4212-8faf-cf9087e7f877 to instance bd14f7e1-11dc-4266-9c6f-3c83be8d5874 at mountpoint /dev/vdb on host None. Jul 08 10:46:21 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-33d375fe-9d22-4772-9b55-8108761d79d8 tempest-VolumesActionsTest-255004225 None] Attach volume completed successfully. Jul 08 10:46:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-33d375fe-9d22-4772-9b55-8108761d79d8 tempest-VolumesActionsTest-255004225 None] Lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877" released by "attach_volume" :: held 0.200s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:22 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-490a069d-4649-465e-bd98-426965dc4d5b tempest-VolumesActionsTest-255004225 None] Acquiring lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877-detach_volume" by "detach_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:22 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-490a069d-4649-465e-bd98-426965dc4d5b tempest-VolumesActionsTest-255004225 None] Lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:22 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-490a069d-4649-465e-bd98-426965dc4d5b tempest-VolumesActionsTest-255004225 None] Detaching volume 88e2c966-a10c-4212-8faf-cf9087e7f877 from instance bd14f7e1-11dc-4266-9c6f-3c83be8d5874. Jul 08 10:46:22 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-490a069d-4649-465e-bd98-426965dc4d5b tempest-VolumesActionsTest-255004225 None] Detach volume completed successfully. Jul 08 10:46:22 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-490a069d-4649-465e-bd98-426965dc4d5b tempest-VolumesActionsTest-255004225 None] Lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877-detach_volume" released by "detach_volume" :: held 0.170s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:22 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7" returned: 0 in 2.344s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:22 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7 Jul 08 10:46:22 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:24 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0313a95e-a7a9-4e36-8255-d64f94106fc7" returned: 0 in 1.921s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Lock "cinder-quobyte-0313a95e-a7a9-4e36-8255-d64f94106fc7" released by "delete_volume" :: held 4.404s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:24 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Created reservations ['db0c6dd1-0e37-44df-9b1f-dc4f34d5cfab', '49beb9d9-9dd3-42be-ace2-2fdcb6b6158c', '5db812e6-8921-42d6-850b-0358b511db46', '8c00f236-14e2-48fd-aba9-0a908b141fe9'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:46:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:25 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:46:25 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:26 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.434s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:46:26 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Deleted volume successfully. Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-637c7a19-95d8-446c-8f44-830c060f0477 tempest-VolumesActionsTest-27091715 None] Lock "cinder-0313a95e-a7a9-4e36-8255-d64f94106fc7-delete_volume" released by "delete_volume" :: held 6.184s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (fe3fce55-2502-4149-8ea9-de390c034858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a1326c-8c06-4a5e-91c0-556eafac1f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a1326c-8c06-4a5e-91c0-556eafac1f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-850764061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4243a97-2b69-4dd8-af9c-9e354f0ecef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:27Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab4873c9-acc7-48f7-bbad-eefaf2e7af61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab4873c9-acc7-48f7-bbad-eefaf2e7af61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37981589-af9f-4afd-9f88-c39ba002c788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37981589-af9f-4afd-9f88-c39ba002c788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4243a97-2b69-4dd8-af9c-9e354f0ecef3', 'volume_name': 'volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8df8ef5-fb48-4ea1-b2d7-6cc6b5316b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8df8ef5-fb48-4ea1-b2d7-6cc6b5316b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d200fc44-7344-43d8-89b3-ee87b602d2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:26 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Volume c4243a97-2b69-4dd8-af9c-9e354f0ecef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3', 'volume_size': 1} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-850764061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4243a97-2b69-4dd8-af9c-9e354f0ecef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:27Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Creating volume c4243a97-2b69-4dd8-af9c-9e354f0ecef3 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:46:26 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:46:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:26 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3 1073741824 Jul 08 10:46:26 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:28 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3 1073741824" returned: 0 in 1.304s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:28 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3 Jul 08 10:46:28 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:29 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3" returned: 0 in 0.849s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] <== create_volume: return (2218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:46:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.221s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d200fc44-7344-43d8-89b3-ee87b602d2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55379724-f6ac-4a2a-a278-44b6b69db8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:29 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Volume volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3 (c4243a97-2b69-4dd8-af9c-9e354f0ecef3): created successfully Jul 08 10:46:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55379724-f6ac-4a2a-a278-44b6b69db8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (fe3fce55-2502-4149-8ea9-de390c034858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-45aebb6e-3acd-41f8-98a5-87915fe6545e tempest-VolumesActionsTest-1489807610 None] Created volume successfully. Jul 08 10:46:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Acquiring lock "cinder-c4243a97-2b69-4dd8-af9c-9e354f0ecef3-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Lock "cinder-c4243a97-2b69-4dd8-af9c-9e354f0ecef3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Acquiring lock "cinder-quobyte-c4243a97-2b69-4dd8-af9c-9e354f0ecef3" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Lock "cinder-quobyte-c4243a97-2b69-4dd8-af9c-9e354f0ecef3" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:30 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1695b30-fd54-4166-b3ce-77c0d68e6353]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:46:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:30 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3 Jul 08 10:46:30 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:31 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3" returned: 0 in 0.930s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:31 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3 Jul 08 10:46:31 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:31 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c4243a97-2b69-4dd8-af9c-9e354f0ecef3" returned: 0 in 0.777s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Lock "cinder-quobyte-c4243a97-2b69-4dd8-af9c-9e354f0ecef3" released by "delete_volume" :: held 1.770s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:31 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Created reservations ['92454300-8f06-462d-b3d8-304823c730f4', '42268fe7-6224-4fc5-b6e9-c06006f3d77d', 'd2ac8bd6-910b-4abe-bea7-00cb258becae', 'c4284516-3673-42e4-8479-e82c2a1c68f5'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:46:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:32 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:46:32 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:32 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.803s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:32 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:46:32 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Deleted volume successfully. Jul 08 10:46:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-65d78add-9ab3-4f5b-98a3-4cf5df1af601 tempest-VolumesActionsTest-27091715 None] Lock "cinder-c4243a97-2b69-4dd8-af9c-9e354f0ecef3-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:32 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (74f2edc1-b4cd-4cfb-87dd-41b72ee9915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1365d3-8175-4739-9eed-e48d1cf3a5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1365d3-8175-4739-9eed-e48d1cf3a5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1860524094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:33Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0276366e-7f25-4fbc-9ac8-ceae6e780460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0276366e-7f25-4fbc-9ac8-ceae6e780460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9118b6-e28d-4c28-b8af-6daf35125e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9118b6-e28d-4c28-b8af-6daf35125e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd', 'volume_name': 'volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b422ff7f-6c4c-48e4-9f8f-049f65229a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b422ff7f-6c4c-48e4-9f8f-049f65229a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de07ab1-c2f7-49db-9f15-5b07133a2baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:33 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Volume ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd', 'volume_size': 1} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1860524094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ce5a0ceec4fd8bea899871572e739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:33Z,use_quota=True,user_id='a6abb5920b71430cae544d29250fcdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Creating volume ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:46:33 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:33 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd 1073741824 Jul 08 10:46:33 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:34 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd 1073741824" returned: 0 in 0.991s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:34 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd Jul 08 10:46:34 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:34 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd" returned: 0 in 0.666s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.081s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de07ab1-c2f7-49db-9f15-5b07133a2baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417888e8-531b-48f2-b635-256dc9b5892e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bde2a7-3606-42dc-863a-cbe4fc14cb61]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:34 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Volume volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd (ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd): created successfully Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417888e8-531b-48f2-b635-256dc9b5892e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Flow 'volume_create_manager' (74f2edc1-b4cd-4cfb-87dd-41b72ee9915d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:34 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-420e1be6-26ef-403f-9949-f83c1be43c3d tempest-VolumesActionsTest-1489807610 None] Created volume successfully. Jul 08 10:46:34 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 Jul 08 10:46:34 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Acquiring lock "cinder-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Lock "cinder-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:35 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877" returned: 0 in 0.959s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:35 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[24454414-1ee0-42b6-8800-e590206fa49b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:46:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Acquiring lock "cinder-quobyte-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:46:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Lock "cinder-quobyte-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:46:35 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[500423d7-13e0-40b6-864a-17cf7fa589cc]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:46:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:35 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 Jul 08 10:46:35 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:36 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd Jul 08 10:46:36 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:37 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877" returned: 0 in 1.251s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.bd6e5f8b-bcb5-4484-ba1e-926c6e968745wdeorhy4.img {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:37 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.bd6e5f8b-bcb5-4484-ba1e-926c6e968745wdeorhy4.img Jul 08 10:46:37 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:37 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd" returned: 0 in 1.371s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:37 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd Jul 08 10:46:37 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:38 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd" returned: 0 in 0.956s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Lock "cinder-quobyte-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd" released by "delete_volume" :: held 2.399s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:38 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Created reservations ['9ed8a9ac-6fbb-4762-b9ec-5f4fbe4f46f7', '66eec744-a39c-4d68-8a77-6cd9c1266c3e', '79c7fe89-7e85-4fa5-9233-c5b4fb087cd2', '85103139-0e79-4bf6-aba2-ac9f4316c0aa'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:46:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:38 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:46:38 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:40 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.819s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:40 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:46:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Deleted volume successfully. Jul 08 10:46:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d95a567e-6d8a-4159-aa10-c8fa29cef01e tempest-VolumesActionsTest-1489807610 None] Lock "cinder-ce876159-7c2b-4ca1-a3f1-509d3d4e9cdd-delete_volume" released by "delete_volume" :: held 4.806s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Flow 'volume_create_manager' (cfcd9ae9-eb14-41b2-9874-6dfc85a98466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb65a4f7-3e4c-428c-a1e9-881e317700c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb65a4f7-3e4c-428c-a1e9-881e317700c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1413512463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e236220-bf13-4026-848a-84193ac25b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5836cd8c9caa4bc39c1fe73c3e0368a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:43Z,use_quota=True,user_id='a9d6507d6b8144dfb8595903d026e713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1982fccb-66a3-498c-9680-bb28326aa159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1982fccb-66a3-498c-9680-bb28326aa159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e48576-e818-4479-99ae-f557d722bd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e48576-e818-4479-99ae-f557d722bd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e236220-bf13-4026-848a-84193ac25b38', 'volume_name': 'volume-4e236220-bf13-4026-848a-84193ac25b38', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172aa175-28b2-4f6c-8338-b526f6e0233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172aa175-28b2-4f6c-8338-b526f6e0233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbec8ae9-5279-4edd-8987-9e67d2aaceee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:43 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Volume 4e236220-bf13-4026-848a-84193ac25b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e236220-bf13-4026-848a-84193ac25b38', 'volume_size': 1} Jul 08 10:46:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:44 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.bd6e5f8b-bcb5-4484-ba1e-926c6e968745wdeorhy4.img" returned: 0 in 7.171s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:44 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c2b151-f854-4fa2-9339-c3c2f319668b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:46:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:44 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 Jul 08 10:46:44 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:45 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877" returned: 0 in 1.158s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:45 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877, size 1024.00 MB, duration 7.17 sec, destination /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.bd6e5f8b-bcb5-4484-ba1e-926c6e968745wdeorhy4.img {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:46:45 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] Converted 1024.00 MB image at 142.77 MB/s Jul 08 10:46:45 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] bd6e5f8b-bcb5-4484-ba1e-926c6e968745 was raw, no need to convert to raw {{(pid=86913) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 10:46:53 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=32,cinder:UPDATE=32,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:46:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:46:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:46:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:46:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:46:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:46:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:46:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:53 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:46:53 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:54 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.872s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:46:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:46:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:46:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:46:55 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:INSERT=9,cinder:SELECT=23,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Flow 'volume_create_manager' (493bf9d0-c414-4eaf-9c6a-2a68beb5b495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f45610-d8c7-4b23-a348-da58db9364f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f45610-d8c7-4b23-a348-da58db9364f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2106662582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f3973c-53a0-4ceb-847d-edbe1c93cc5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ea78e456c64d1ba1ad56e6e8f29c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:56Z,use_quota=True,user_id='39431ed1f40c4203a87464671966bb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f47144-cba4-4c07-b468-1b6cc54f0a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f47144-cba4-4c07-b468-1b6cc54f0a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9112310-7f74-47aa-9f54-1603b2c45e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.image.glance [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Creating Keystone auth plugin from conf {{(pid=86913) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9112310-7f74-47aa-9f54-1603b2c45e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58f3973c-53a0-4ceb-847d-edbe1c93cc5e', 'volume_name': 'volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fef909-84f9-4b8a-b131-2b03430a3933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fef909-84f9-4b8a-b131-2b03430a3933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888660b3-c0f9-48f9-9894-1461cbe152bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:46:56 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Volume 58f3973c-53a0-4ceb-847d-edbe1c93cc5e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 10:46:56 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Trying to clone 58f3973c-53a0-4ceb-847d-edbe1c93cc5e from image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]). {{(pid=86913) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 10:46:57 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 10:46:57 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Image download 20.69 MB at 20.69 MB/s Jul 08 10:46:57 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28edf93-c009-4d84-871d-294c8bf18a3e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:46:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:57 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD Jul 08 10:46:57 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:58 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD" returned: 0 in 1.294s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:58 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Temporary image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c is fetched for user 39431ed1f40c4203a87464671966bb06. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 10:46:58 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a00877c-c77a-4a19-b209-74cc0cc7aca6]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:46:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:46:58 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD Jul 08 10:46:58 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:46:59 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 08 10:46:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD" returned: 0 in 0.998s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:46:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:08 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=3 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:47:08 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.350s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] Uploaded volume to glance image-id: bd6e5f8b-bcb5-4484-ba1e-926c6e968745. {{(pid=86913) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.433s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1413512463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e236220-bf13-4026-848a-84193ac25b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5836cd8c9caa4bc39c1fe73c3e0368a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:43Z,use_quota=True,user_id='a9d6507d6b8144dfb8595903d026e713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Creating volume 4e236220-bf13-4026-848a-84193ac25b38 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:47:10 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:47:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:10 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-832749b4-22b9-4cdd-aa36-1374f2c10597 tempest-VolumesActionsTest-255004225 None] Copy volume to image completed successfully. Jul 08 10:47:10 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38 1073741824 Jul 08 10:47:10 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:11 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38 1073741824" returned: 0 in 1.070s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:11 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38 Jul 08 10:47:11 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:12 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38" returned: 0 in 0.812s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.474s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2106662582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f3973c-53a0-4ceb-847d-edbe1c93cc5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ea78e456c64d1ba1ad56e6e8f29c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:46:56Z,use_quota=True,user_id='39431ed1f40c4203a87464671966bb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Creating volume 58f3973c-53a0-4ceb-847d-edbe1c93cc5e {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:47:12 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:12 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e 1073741824 Jul 08 10:47:12 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbec8ae9-5279-4edd-8987-9e67d2aaceee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e236220-bf13-4026-848a-84193ac25b38', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13689822-f8ce-4c71-9ae4-c31af0e352e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:12 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Volume volume-4e236220-bf13-4026-848a-84193ac25b38 (4e236220-bf13-4026-848a-84193ac25b38): created successfully Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13689822-f8ce-4c71-9ae4-c31af0e352e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Flow 'volume_create_manager' (cfcd9ae9-eb14-41b2-9874-6dfc85a98466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:47:12 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9fc2ffa6-97e5-4c97-8901-1c3d0f12cdc0 tempest-AttachVolumeNegativeTest-1715871990 None] Created volume successfully. Jul 08 10:47:13 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e 1073741824" returned: 0 in 0.976s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:13 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e Jul 08 10:47:13 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:13 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e" returned: 0 in 0.701s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:47:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.862s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:13 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e6b441-58db-425e-bbd5-bf0f9dc2a5bc]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:13 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Attempting download of 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c ((None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}])) to volume 58f3973c-53a0-4ceb-847d-edbe1c93cc5e. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 10:47:13 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[242d384b-3613-4642-9bea-8ff0f36eef56]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_qrt_oa25 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:14 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 Jul 08 10:47:14 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:14 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_qrt_oa25 Jul 08 10:47:14 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:14 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877" returned: 0 in 0.882s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:14 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1f4e7e-3c63-47f2-8ab2-7139dd304213]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:14 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_qrt_oa25" returned: 0 in 0.823s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_qrt_oa25 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:14 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 Jul 08 10:47:14 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:14 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_qrt_oa25 Jul 08 10:47:14 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:15 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_qrt_oa25" returned: 1 in 0.740s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_qrt_oa25' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:47:15 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bae342-3d52-4bfc-97f5-91a7cc654bbe]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:15 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877" returned: 0 in 0.819s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:15 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img Jul 08 10:47:15 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:15 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD Jul 08 10:47:15 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-4960aeba-8265-477e-a470-c43da3814578 req-41da068a-a8d4-4cd9-bb07-ee2f7b6a36b1 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:16 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:16 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c was qcow2, converting to raw {{(pid=86913) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 10:47:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:16 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e Jul 08 10:47:16 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:20 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e" returned: 0 in 4.150s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:20 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_rwtm_c5edevstack@QuobyteHD, size 112.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:47:20 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Converted 112.00 MB image at 26.97 MB/s Jul 08 10:47:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:20 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e 1G Jul 08 10:47:20 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:20 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img" returned: 0 in 5.211s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:20 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0345f65a-28ff-49ae-b107-6e29bffb8ed6]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:20 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 Jul 08 10:47:20 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:21 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e 1G" returned: 0 in 0.889s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:21 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8d98e6-8b79-43f2-b60d-e96d6baac529]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:21 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e Jul 08 10:47:21 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:21 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877" returned: 0 in 0.930s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:21 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:47:21 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Converted 1024.00 MB image at 196.47 MB/s Jul 08 10:47:21 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] 09664b33-ef38-41fe-b1d4-42b0080a67f0 was raw, converting to qcow2 {{(pid=86913) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 10:47:21 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a19b570-82ee-4557-b2bc-8ac420cc9300]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:21 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img Jul 08 10:47:21 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:22 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e" returned: 0 in 0.803s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:22 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e Jul 08 10:47:22 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:22 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img" returned: 0 in 0.752s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:22 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img Jul 08 10:47:22 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:23 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e" returned: 1 in 0.812s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Downloaded image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c ((None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}])) to volume 58f3973c-53a0-4ceb-847d-edbe1c93cc5e successfully. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Temporary image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c for user 39431ed1f40c4203a87464671966bb06 is deleted. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Marking volume 58f3973c-53a0-4ceb-847d-edbe1c93cc5e as bootable. {{(pid=86913) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Copying metadata from image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c to 58f3973c-53a0-4ceb-847d-edbe1c93cc5e. {{(pid=86913) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Creating volume glance metadata for volume 58f3973c-53a0-4ceb-847d-edbe1c93cc5e backed by image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86913) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888660b3-c0f9-48f9-9894-1461cbe152bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ea8949-42a2-4411-aa45-721bf37fcbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:23 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Volume volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e (58f3973c-53a0-4ceb-847d-edbe1c93cc5e): created successfully Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ea8949-42a2-4411-aa45-721bf37fcbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Flow 'volume_create_manager' (493bf9d0-c414-4eaf-9c6a-2a68beb5b495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:47:23 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a89fdcc2-a337-471e-94b7-821f0909d45f tempest-VolumesImageMetadata-280029731 None] Created volume successfully. Jul 08 10:47:23 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img" returned: 1 in 0.746s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img /opt/stack/data/cinder/conversion/vol_upload_jgw__ze_ {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:23 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img /opt/stack/data/cinder/conversion/vol_upload_jgw__ze_ Jul 08 10:47:23 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Acquiring lock "cinder-58f3973c-53a0-4ceb-847d-edbe1c93cc5e-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Lock "cinder-58f3973c-53a0-4ceb-847d-edbe1c93cc5e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Acquiring lock "cinder-quobyte-58f3973c-53a0-4ceb-847d-edbe1c93cc5e" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Lock "cinder-quobyte-58f3973c-53a0-4ceb-847d-edbe1c93cc5e" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:23 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img /opt/stack/data/cinder/conversion/vol_upload_jgw__ze_" returned: 0 in 0.704s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:23 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Image conversion details: src /opt/stack/data/cinder/conversion/88e2c966-a10c-4212-8faf-cf9087e7f877.temp_image.09664b33-ef38-41fe-b1d4-42b0080a67f08b7_55me.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jgw__ze_ {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:47:23 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 10:47:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[1016733d-fc3d-4cd0-8ef8-b700c9a91b7d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jgw__ze_ {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8422309b-f0c0-49db-b972-79e21bebf802]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:24 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jgw__ze_ Jul 08 10:47:24 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:24 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e Jul 08 10:47:24 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:24 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jgw__ze_" returned: 0 in 0.774s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:24 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e" returned: 0 in 0.790s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:24 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e Jul 08 10:47:24 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:25 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e" returned: 1 in 0.850s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:47:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:25 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e Jul 08 10:47:25 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Flow 'volume_create_manager' (c0b733c7-d7d8-42fb-af00-8dc40f5220ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a22b9a-48d8-4ff1-a592-8a7a1b88df2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a22b9a-48d8-4ff1-a592-8a7a1b88df2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1297110147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd29a92-6e1d-4ede-a49a-22c880730d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678a9c94ad5944bfac079e8499a4726f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:47:26Z,use_quota=True,user_id='2a4506f566d64fa292f2131b3eedf13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01217a9-82c1-4694-9031-588515c7bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01217a9-82c1-4694-9031-588515c7bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb11977-b2f3-45b2-9305-59a67354dfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb11977-b2f3-45b2-9305-59a67354dfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd29a92-6e1d-4ede-a49a-22c880730d0f', 'volume_name': 'volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12bf533-a2e7-4161-9f99-7142d78555a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12bf533-a2e7-4161-9f99-7142d78555a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19effa68-6d96-4404-81a7-3e24fb6b4e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:26 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Volume cbd29a92-6e1d-4ede-a49a-22c880730d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f', 'volume_size': 1} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.520s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Uploaded volume to glance image-id: 09664b33-ef38-41fe-b1d4-42b0080a67f0. {{(pid=86913) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-4960aeba-8265-477e-a470-c43da3814578 req-41da068a-a8d4-4cd9-bb07-ee2f7b6a36b1 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.502s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:26 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-7bcb6f0a-e324-4ab6-b696-0e4e979afae0 tempest-VolumesActionsTest-255004225 None] Copy volume to image completed successfully. Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4164f8-8fd1-4b8b-a000-69ef5a98a4ac]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-4960aeba-8265-477e-a470-c43da3814578 req-41da068a-a8d4-4cd9-bb07-ee2f7b6a36b1 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:26 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58f3973c-53a0-4ceb-847d-edbe1c93cc5e" returned: 0 in 0.805s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Lock "cinder-quobyte-58f3973c-53a0-4ceb-847d-edbe1c93cc5e" released by "delete_volume" :: held 2.510s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:26 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38 Jul 08 10:47:26 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Created reservations ['f6b7a4d8-381b-468c-a747-cb1efd7584d3', '4ccd7aaa-3d69-4124-b63a-ec9ea026722e', '0d7776d4-668a-4bfd-9ec9-b82e801bc91b', 'a481b57e-fba3-4ca5-923e-f6cb2c9cdb55'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:26 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:47:26 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:27 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-4960aeba-8265-477e-a470-c43da3814578 req-41da068a-a8d4-4cd9-bb07-ee2f7b6a36b1 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38" returned: 0 in 0.900s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-4960aeba-8265-477e-a470-c43da3814578 req-41da068a-a8d4-4cd9-bb07-ee2f7b6a36b1 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.929s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1297110147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd29a92-6e1d-4ede-a49a-22c880730d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678a9c94ad5944bfac079e8499a4726f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:47:26Z,use_quota=True,user_id='2a4506f566d64fa292f2131b3eedf13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Creating volume cbd29a92-6e1d-4ede-a49a-22c880730d0f {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:47:27 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:27 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.731s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:47:27 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f 1073741824 Jul 08 10:47:27 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Deleted volume successfully. Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-4960aeba-8265-477e-a470-c43da3814578 req-41da068a-a8d4-4cd9-bb07-ee2f7b6a36b1 tempest-AttachVolumeNegativeTest-1715871990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-4e236220-bf13-4026-848a-84193ac25b38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b2438cf-862b-4c5e-971e-cbf625026363', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eada5e68-1966-47dc-a2e6-721e870b661c tempest-VolumesImageMetadata-280029731 None] Lock "cinder-58f3973c-53a0-4ceb-847d-edbe1c93cc5e-delete_volume" released by "delete_volume" :: held 3.505s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Acquiring lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-4960aeba-8265-477e-a470-c43da3814578 req-41da068a-a8d4-4cd9-bb07-ee2f7b6a36b1 tempest-AttachVolumeNegativeTest-1715871990 None] attachment_update completed successfully. Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Acquiring lock "cinder-quobyte-88e2c966-a10c-4212-8faf-cf9087e7f877" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Lock "cinder-quobyte-88e2c966-a10c-4212-8faf-cf9087e7f877" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e2aa3b-1be8-48d6-935c-b60b7ede4213]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:27 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 Jul 08 10:47:27 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:28 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f 1073741824" returned: 0 in 1.170s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:28 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877" returned: 0 in 0.953s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:28 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f Jul 08 10:47:28 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:28 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877 Jul 08 10:47:28 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:29 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f" returned: 0 in 0.852s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19effa68-6d96-4404-81a7-3e24fb6b4e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6063f11-bfb4-42a5-a0d3-1010da9a490c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:29 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Volume volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f (cbd29a92-6e1d-4ede-a49a-22c880730d0f): created successfully Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6063f11-bfb4-42a5-a0d3-1010da9a490c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Flow 'volume_create_manager' (c0b733c7-d7d8-42fb-af00-8dc40f5220ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:47:29 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-88e2c966-a10c-4212-8faf-cf9087e7f877" returned: 0 in 0.895s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-04857de1-0d85-4023-8f44-27602b04aa45 tempest-AttachVolumeTestJSON-956411359 None] Created volume successfully. Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Lock "cinder-quobyte-88e2c966-a10c-4212-8faf-cf9087e7f877" released by "delete_volume" :: held 1.900s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Created reservations ['da7fe32c-8c31-4e99-b63e-dc40e7bbdb35', '8fadcfdb-f481-4e7e-8f52-e1db0796fd3c', '5df994bb-b4e4-464b-a19b-466d83699a12', '3658f379-395c-4a40-a7cf-3b1b2434fa6d'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:29 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:47:29 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:30 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.758s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:30 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:47:30 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Deleted volume successfully. Jul 08 10:47:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4378babc-6be5-46d4-8d42-1add7903c32f tempest-VolumesActionsTest-255004225 None] Lock "cinder-88e2c966-a10c-4212-8faf-cf9087e7f877-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Flow 'volume_create_manager' (6dbf08ad-d859-471e-9ed2-ca8f0ac2977e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136e673e-d588-4853-9b04-91b89affd330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136e673e-d588-4853-9b04-91b89affd330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2108124060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7792d8-a4b0-4da6-9b72-f3c99f370a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f8eca51ba8439aaa9b02f8ebd4a883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:47:32Z,use_quota=True,user_id='8858dd4891a44fd6ac3dbd1ea3dfcde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c84582-705b-42ea-9f5b-76ee633939d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c84582-705b-42ea-9f5b-76ee633939d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8c057f-2734-4598-8939-542c7baf7473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8c057f-2734-4598-8939-542c7baf7473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af7792d8-a4b0-4da6-9b72-f3c99f370a58', 'volume_name': 'volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0111b1bb-de49-4b1b-b54b-c232c67dfe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0111b1bb-de49-4b1b-b54b-c232c67dfe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d085f6-2624-46da-b3b0-ef0f279e805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:31 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Volume af7792d8-a4b0-4da6-9b72-f3c99f370a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58', 'volume_size': 1} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2108124060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7792d8-a4b0-4da6-9b72-f3c99f370a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f8eca51ba8439aaa9b02f8ebd4a883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:47:32Z,use_quota=True,user_id='8858dd4891a44fd6ac3dbd1ea3dfcde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Creating volume af7792d8-a4b0-4da6-9b72-f3c99f370a58 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:47:31 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:47:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:31 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58 1073741824 Jul 08 10:47:31 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:33 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58 1073741824" returned: 0 in 1.107s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:33 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58 Jul 08 10:47:33 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:33 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58" returned: 0 in 0.729s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:47:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d085f6-2624-46da-b3b0-ef0f279e805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ac8aad-aa24-42bb-8471-8f3b53c138e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:33 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Volume volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58 (af7792d8-a4b0-4da6-9b72-f3c99f370a58): created successfully Jul 08 10:47:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ac8aad-aa24-42bb-8471-8f3b53c138e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Flow 'volume_create_manager' (6dbf08ad-d859-471e-9ed2-ca8f0ac2977e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:47:33 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e510b4ef-466f-4672-83ca-77062c19d998 tempest-AbsoluteLimitsTests-1110817238 None] Created volume successfully. Jul 08 10:47:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-562b32dd-f338-4b15-8dee-3ca14609382f req-3fe538bb-f985-4596-ac0f-2f6721be357c tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-562b32dd-f338-4b15-8dee-3ca14609382f req-3fe538bb-f985-4596-ac0f-2f6721be357c tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:34 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1d323d-3413-475f-8380-d7b2cd5ebd73]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-562b32dd-f338-4b15-8dee-3ca14609382f req-3fe538bb-f985-4596-ac0f-2f6721be357c tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Acquiring lock "cinder-af7792d8-a4b0-4da6-9b72-f3c99f370a58-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Lock "cinder-af7792d8-a4b0-4da6-9b72-f3c99f370a58-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:34 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f Jul 08 10:47:34 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Acquiring lock "cinder-quobyte-af7792d8-a4b0-4da6-9b72-f3c99f370a58" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Lock "cinder-quobyte-af7792d8-a4b0-4da6-9b72-f3c99f370a58" acquired by "delete_volume" :: waited 0.035s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:34 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[7911852c-6f0a-4535-894b-f3380a448770]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:34 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58 Jul 08 10:47:34 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:34 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-06767978-a20a-4692-9923-2d75d0b0b572 req-1326bb75-8c13-4894-be4a-bb27dad6b795 tempest-AttachVolumeNegativeTest-1715871990 None] Terminate volume connection completed successfully. Jul 08 10:47:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-06767978-a20a-4692-9923-2d75d0b0b572 req-1326bb75-8c13-4894-be4a-bb27dad6b795 tempest-AttachVolumeNegativeTest-1715871990 None] Deleting attachment 5b2438cf-862b-4c5e-971e-cbf625026363. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:47:35 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-562b32dd-f338-4b15-8dee-3ca14609382f req-3fe538bb-f985-4596-ac0f-2f6721be357c tempest-AttachVolumeTestJSON-956411359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f" returned: 0 in 0.972s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-562b32dd-f338-4b15-8dee-3ca14609382f req-3fe538bb-f985-4596-ac0f-2f6721be357c tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-562b32dd-f338-4b15-8dee-3ca14609382f req-3fe538bb-f985-4596-ac0f-2f6721be357c tempest-AttachVolumeTestJSON-956411359 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf816ce0-c6da-4d0b-afcd-9970430fc9d7', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:47:35 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-562b32dd-f338-4b15-8dee-3ca14609382f req-3fe538bb-f985-4596-ac0f-2f6721be357c tempest-AttachVolumeTestJSON-956411359 None] attachment_update completed successfully. Jul 08 10:47:35 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58" returned: 0 in 0.989s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:35 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58 Jul 08 10:47:35 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:36 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-af7792d8-a4b0-4da6-9b72-f3c99f370a58" returned: 0 in 0.720s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Lock "cinder-quobyte-af7792d8-a4b0-4da6-9b72-f3c99f370a58" released by "delete_volume" :: held 1.772s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:36 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Created reservations ['3df8addd-ca18-49d1-8852-948337f8cea1', '5465fb33-9ebf-42bb-a001-c9fba766ec4f', '8bf4604d-bb52-4726-8d86-fbbe9bf731d9', 'f5c90e34-2392-43f0-9066-fff5cd364cb2'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:47:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:36 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:47:36 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:37 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.932s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:47:37 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Deleted volume successfully. Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5e62d452-4071-4d65-9f89-71ee3d79904a tempest-AbsoluteLimitsTests-1110817238 None] Lock "cinder-af7792d8-a4b0-4da6-9b72-f3c99f370a58-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Flow 'volume_create_manager' (2f679734-e1e3-44a3-bfe8-39027d1767fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fed5d61-8f3a-405d-8d16-6cd8affb7b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fed5d61-8f3a-405d-8d16-6cd8affb7b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1177418990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e4d1f0-e7db-41c9-940b-5ea8b0be03c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f3a425b60547e2b7ffc6a87cc1cb2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:47:37Z,use_quota=True,user_id='912bbbd93b5a4afd9e32c52fd648ec5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a14b1d3-6584-43b2-97bc-834905f9c559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a14b1d3-6584-43b2-97bc-834905f9c559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a8af21-c2c9-4eea-8418-b8f1b051ceda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a8af21-c2c9-4eea-8418-b8f1b051ceda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e4d1f0-e7db-41c9-940b-5ea8b0be03c5', 'volume_name': 'volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1032621f-1c46-473e-84fd-c72616abedca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1032621f-1c46-473e-84fd-c72616abedca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6816b239-7664-4edf-92f8-6b82d06a0b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:37 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Volume 58e4d1f0-e7db-41c9-940b-5ea8b0be03c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5', 'volume_size': 1} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1177418990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e4d1f0-e7db-41c9-940b-5ea8b0be03c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f3a425b60547e2b7ffc6a87cc1cb2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:47:37Z,use_quota=True,user_id='912bbbd93b5a4afd9e32c52fd648ec5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Creating volume 58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:47:37 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:47:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:37 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 1073741824 Jul 08 10:47:37 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:38 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 1073741824" returned: 0 in 1.060s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:38 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 Jul 08 10:47:38 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:39 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5" returned: 0 in 0.920s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:47:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6816b239-7664-4edf-92f8-6b82d06a0b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658e5e59-c074-4536-be3c-67a829b070da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:39 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Volume volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 (58e4d1f0-e7db-41c9-940b-5ea8b0be03c5): created successfully Jul 08 10:47:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658e5e59-c074-4536-be3c-67a829b070da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Flow 'volume_create_manager' (2f679734-e1e3-44a3-bfe8-39027d1767fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:47:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b0faf7a0-b72c-4a43-ac49-80a2bf0532c7 tempest-VolumesCloneTest-1992171752 None] Created volume successfully. Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Flow 'volume_create_manager' (6543db38-11e3-4593-8d6c-979f56ebe638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15dbf8b-a3ba-49c9-bc2c-e648cf392f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15dbf8b-a3ba-49c9-bc2c-e648cf392f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-38527309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5604c368-789e-45bb-8be0-a62ded77769f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f3a425b60547e2b7ffc6a87cc1cb2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:47:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=58e4d1f0-e7db-41c9-940b-5ea8b0be03c5,status='creating',terminated_at=None,updated_at=2026-07-08T08:47:41Z,use_quota=True,user_id='912bbbd93b5a4afd9e32c52fd648ec5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23214cd1-8afb-466b-8286-0dd7f8776303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23214cd1-8afb-466b-8286-0dd7f8776303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466935ba-5ee5-4b04-bae8-72de10f5c1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466935ba-5ee5-4b04-bae8-72de10f5c1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5604c368-789e-45bb-8be0-a62ded77769f', 'volume_name': 'volume-5604c368-789e-45bb-8be0-a62ded77769f', 'volume_size': 2, 'source_volid': '58e4d1f0-e7db-41c9-940b-5ea8b0be03c5', 'source_volstatus': 'available'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3202edf3-4235-4f6a-85f7-ba98c4fc3b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3202edf3-4235-4f6a-85f7-ba98c4fc3b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6844ba39-d212-4999-9d5d-95fef51c6a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:41 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Volume 5604c368-789e-45bb-8be0-a62ded77769f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5604c368-789e-45bb-8be0-a62ded77769f', 'volume_size': 2, 'source_volid': '58e4d1f0-e7db-41c9-940b-5ea8b0be03c5', 'source_volstatus': 'available'} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:41 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Cloning volume 58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 to volume 5604c368-789e-45bb-8be0-a62ded77769f Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Creating offline snapshot 2ae7c136-1239-400d-bf1f-92db36a170e0 of volume 58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4a676b-803f-46e4-a823-9a5afdf6bcb5]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:41 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 Jul 08 10:47:41 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:42 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5" returned: 0 in 0.921s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:42 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 1G Jul 08 10:47:42 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:43 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 1G" returned: 0 in 0.943s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:43 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 Jul 08 10:47:43 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:43 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0" returned: 0 in 0.793s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:43 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 is being set with open permissions: ugo+rw Jul 08 10:47:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:44 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 Jul 08 10:47:44 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Flow 'volume_create_manager' (3ff257d5-b808-4f8e-8d0b-bc61e9e9865b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d6637f-6b57-4c94-9963-bd435a22d666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d6637f-6b57-4c94-9963-bd435a22d666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1863239555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd98c1b9650544aba7b43ffa0b27d8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:47:44Z,use_quota=True,user_id='ec4a81ecdf9a495aa311ad48bb57b2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ce5c80-ac96-46e5-be14-27c482ea9d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ce5c80-ac96-46e5-be14-27c482ea9d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986a2b8f-f800-43ef-991d-4c39a6b82587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986a2b8f-f800-43ef-991d-4c39a6b82587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e', 'volume_name': 'volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d16c2c-7a8b-4df8-9643-9111ce4eaaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d16c2c-7a8b-4df8-9643-9111ce4eaaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9b079c-c021-4719-ba83-b13d017a1692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:47:44 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Volume 0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e', 'volume_size': 1} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:44 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0" returned: 0 in 0.712s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:44 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.info Jul 08 10:47:44 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "cinder-4e236220-bf13-4026-848a-84193ac25b38-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-4e236220-bf13-4026-848a-84193ac25b38-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "cinder-quobyte-4e236220-bf13-4026-848a-84193ac25b38" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-quobyte-4e236220-bf13-4026-848a-84193ac25b38" acquired by "delete_volume" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:45 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[213e200e-a37a-4b6b-a7e0-590f4670e3ff]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:45 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.info" returned: 0 in 0.731s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:45 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.info is being set with open permissions: ugo+rw Jul 08 10:47:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:45 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.info Jul 08 10:47:45 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:45 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38 Jul 08 10:47:45 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:46 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.info" returned: 0 in 0.674s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Acquiring lock "cinder-quobyte-5604c368-789e-45bb-8be0-a62ded77769f" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Lock "cinder-quobyte-5604c368-789e-45bb-8be0-a62ded77769f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] snapshot: 2ae7c136-1239-400d-bf1f-92db36a170e0, volume: 5604c368-789e-45bb-8be0-a62ded77769f, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29ffd53-2d1f-4b3f-8645-6a4d9df37104]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:46 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38" returned: 0 in 0.888s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:46 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38 Jul 08 10:47:46 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:46 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 Jul 08 10:47:46 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:47 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:47 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4e236220-bf13-4026-848a-84193ac25b38" returned: 0 in 0.717s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0" returned: 0 in 0.805s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-quobyte-4e236220-bf13-4026-848a-84193ac25b38" released by "delete_volume" :: held 1.649s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f23cc3-42bd-46c2-8602-b149db9e6460]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Created reservations ['c03a5b90-3907-4a26-b72a-f257c995d537', 'a5e464ed-3b87-4272-9d65-50ed5b541a83', 'e940d33d-1d95-4282-96ac-7f55dc166d4d', '40d9d265-300f-4074-aef7-db9b5f40572c'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:47 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 Jul 08 10:47:47 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:47 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:47:47 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "cinder-43d882fa-a2f5-41b2-83c5-65c996227917-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-43d882fa-a2f5-41b2-83c5-65c996227917-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "cinder-quobyte-43d882fa-a2f5-41b2-83c5-65c996227917" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-quobyte-43d882fa-a2f5-41b2-83c5-65c996227917" acquired by "delete_volume" :: waited 0.033s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac0ecf0-dae0-4b71-a998-eed4b5ee98e2]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:47 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.700s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:47:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Deleted volume successfully. Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-da76298f-57e6-429e-81c9-9ded79fcd716 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-4e236220-bf13-4026-848a-84193ac25b38-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:47 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917 Jul 08 10:47:47 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:47 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5" returned: 0 in 0.897s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 10:47:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:47 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f Jul 08 10:47:47 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:48 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917" returned: 0 in 0.845s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:48 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917 Jul 08 10:47:48 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:50 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-43d882fa-a2f5-41b2-83c5-65c996227917" returned: 0 in 1.894s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-quobyte-43d882fa-a2f5-41b2-83c5-65c996227917" released by "delete_volume" :: held 2.833s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:50 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Created reservations ['0561169c-0393-4bfc-9f19-5804bcd64940', 'bb3f267e-27ec-41a9-abcd-de89b79b4dde', '8e21cbeb-cf61-492f-a5a9-245cbf6ef03f', '15d36303-33e4-4f55-85f0-34f328050925'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:47:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:51 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:47:51 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "cinder-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "cinder-quobyte-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-quobyte-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9" acquired by "delete_volume" :: waited 0.063s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:52 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c02edbf-db6a-43cf-a370-636b1e2ef3f9]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:52 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 Jul 08 10:47:52 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:52 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.951s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:52 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:47:53 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Deleted volume successfully. Jul 08 10:47:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e5d27773-9574-4d4c-9255-3d7ef8ed87e5 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-43d882fa-a2f5-41b2-83c5-65c996227917-delete_volume" released by "delete_volume" :: held 5.376s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:47:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:54 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9" returned: 0 in 1.847s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:54 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:47:54 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:54 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9 Jul 08 10:47:54 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:54 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f" returned: 0 in 7.021s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:54 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bc2ca3-7454-4625-8fc2-d72edcfd256b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:55 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 Jul 08 10:47:55 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:55 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.827s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:47:55 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9" returned: 0 in 1.759s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-quobyte-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9" released by "delete_volume" :: held 3.727s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Created reservations ['659581ee-9ddc-454b-979b-8f15f8c8f582', 'dae65724-0560-4f92-91a8-368c0aed1ee6', '2b17c568-cec5-4e89-acf0-b7481cd88655', '78625cfe-d2c3-4c9b-a913-384919917cad'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:47:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:56 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:47:56 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:56 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5" returned: 0 in 1.516s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:56 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:47:56 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Converted 1024.00 MB image at 145.81 MB/s Jul 08 10:47:56 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f is being set with open permissions: ugo+rw Jul 08 10:47:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:56 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f Jul 08 10:47:56 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:56 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.741s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:56 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:47:56 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Deleted volume successfully. Jul 08 10:47:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac6d329a-662e-4b87-a8b9-a0ac3c25ed99 tempest-AttachVolumeNegativeTest-1715871990 None] Lock "cinder-cd76b6eb-768f-46c0-a3e2-fd74920ad4e9-delete_volume" released by "delete_volume" :: held 4.871s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:57 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f" returned: 0 in 0.918s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Lock "cinder-quobyte-5604c368-789e-45bb-8be0-a62ded77769f" released by "_copy_volume_from_snapshot" :: held 11.289s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:47:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Acquiring lock "cinder-quobyte-2ae7c136-1239-400d-bf1f-92db36a170e0" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:47:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Lock "cinder-quobyte-2ae7c136-1239-400d-bf1f-92db36a170e0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:47:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Deleting offline snapshot 2ae7c136-1239-400d-bf1f-92db36a170e0 of volume 58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:47:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] snapshot_file for this snap is: volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:47:57 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aea3b9-802b-4f36-8a4b-e99c29735dbc]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:57 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 Jul 08 10:47:57 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:58 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0" returned: 0 in 1.034s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:47:58 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd4a89e-b9b0-49ab-bbb4-97436baa86d5]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:47:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:58 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 Jul 08 10:47:58 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:47:59 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 08 10:47:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5" returned: 0 in 1.048s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:47:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:47:59 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 Jul 08 10:47:59 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:00 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0" returned: 0 in 0.893s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:00 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0 Jul 08 10:48:00 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:01 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5.2ae7c136-1239-400d-bf1f-92db36a170e0" returned: 0 in 0.808s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Lock "cinder-quobyte-2ae7c136-1239-400d-bf1f-92db36a170e0" released by "_delete_snapshot" :: held 3.944s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.262s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.139s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1863239555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd98c1b9650544aba7b43ffa0b27d8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:47:44Z,use_quota=True,user_id='ec4a81ecdf9a495aa311ad48bb57b2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Creating volume 0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:01 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6844ba39-d212-4999-9d5d-95fef51c6a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5604c368-789e-45bb-8be0-a62ded77769f', 'volume_size': 2, 'source_volid': '58e4d1f0-e7db-41c9-940b-5ea8b0be03c5', 'source_volstatus': 'available'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:01 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e 1073741824 Jul 08 10:48:01 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b73a4-afc2-42bc-8dbf-e8aa53b274e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:01 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Volume volume-5604c368-789e-45bb-8be0-a62ded77769f (5604c368-789e-45bb-8be0-a62ded77769f): created successfully Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b73a4-afc2-42bc-8dbf-e8aa53b274e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Flow 'volume_create_manager' (6543db38-11e3-4593-8d6c-979f56ebe638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:01 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e85acd11-4412-41e0-8208-ddf199dc4c0d tempest-VolumesCloneTest-1992171752 None] Created volume successfully. Jul 08 10:48:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Acquiring lock "cinder-5604c368-789e-45bb-8be0-a62ded77769f-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Lock "cinder-5604c368-789e-45bb-8be0-a62ded77769f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:02 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e 1073741824" returned: 0 in 1.258s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Acquiring lock "cinder-quobyte-5604c368-789e-45bb-8be0-a62ded77769f" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Lock "cinder-quobyte-5604c368-789e-45bb-8be0-a62ded77769f" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2d1210-2c46-4796-9a90-5a748f8eda1b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:02 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e Jul 08 10:48:02 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:03 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f Jul 08 10:48:03 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:03 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e" returned: 0 in 1.016s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] <== create_volume: return (2368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.375s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9b079c-c021-4719-ba83-b13d017a1692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e8c722-e972-4126-b11b-706497667b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:03 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Volume volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e (0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e): created successfully Jul 08 10:48:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e8c722-e972-4126-b11b-706497667b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Flow 'volume_create_manager' (3ff257d5-b808-4f8e-8d0b-bc61e9e9865b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:04 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:04 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c643fe26-d405-48b0-8867-316560cdf329 tempest-VolumesTransfersV355Test-920401156 None] Created volume successfully. Jul 08 10:48:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f" returned: 0 in 1.114s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:04 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f Jul 08 10:48:04 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:04 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5604c368-789e-45bb-8be0-a62ded77769f" returned: 0 in 0.863s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Lock "cinder-quobyte-5604c368-789e-45bb-8be0-a62ded77769f" released by "delete_volume" :: held 2.054s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:04 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Created reservations ['26ea2082-1aaf-4cf6-bdfa-5c3f2f9b000b', '65f073ea-c4f7-47be-8240-9f55d79330e9', 'f4d0bebe-3337-4e7b-835e-a3797d99a90a', '91734a4c-3f62-4945-866c-ee0bb8d91f05'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:05 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:05 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5061fc51-1bee-459e-80b5-fe1c67ae92e0 tempest-VolumesTransfersV355Test-813470740 None] Transfer volume completed successfully. Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Flow 'volume_create_manager' (fbab0fa9-f74a-4bf1-8857-5608b29d6ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5db2b4f-bcd3-4e22-a34c-23a281353aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5db2b4f-bcd3-4e22-a34c-23a281353aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-218020340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c171835e-98e3-4b89-ab5a-cbb63382e0c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6dc140f06923437fbac4ad3d278acb83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:06Z,use_quota=True,user_id='0aad1c5a46924d248ce698f387f8af4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf1379f-0ecc-4847-aab4-e28da8bc278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf1379f-0ecc-4847-aab4-e28da8bc278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49a91b0-97b9-44d6-bd7a-31dba68d0306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49a91b0-97b9-44d6-bd7a-31dba68d0306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c171835e-98e3-4b89-ab5a-cbb63382e0c5', 'volume_name': 'volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e104e35b-698e-4a5e-8c16-0040e8cabe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e104e35b-698e-4a5e-8c16-0040e8cabe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:06 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da752a4-d0c3-4481-a67e-4bc3b6070ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:06 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Volume c171835e-98e3-4b89-ab5a-cbb63382e0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5', 'volume_size': 1} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-218020340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c171835e-98e3-4b89-ab5a-cbb63382e0c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6dc140f06923437fbac4ad3d278acb83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:06Z,use_quota=True,user_id='0aad1c5a46924d248ce698f387f8af4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Creating volume c171835e-98e3-4b89-ab5a-cbb63382e0c5 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:06 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.964s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:06 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Deleted volume successfully. Jul 08 10:48:06 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5 1073741824 Jul 08 10:48:06 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cfef146a-dbc9-4599-93c2-c1610ece06ef tempest-VolumesCloneTest-1992171752 None] Lock "cinder-5604c368-789e-45bb-8be0-a62ded77769f-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Acquiring lock "cinder-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Lock "cinder-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Acquiring lock "cinder-quobyte-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Lock "cinder-quobyte-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[061c5d33-dc49-4933-a8b4-040b204f4e9b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:06 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 Jul 08 10:48:06 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Acquiring lock "cinder-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Lock "cinder-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Acquiring lock "cinder-quobyte-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Lock "cinder-quobyte-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e" acquired by "delete_volume" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a88bb7-27fe-4c69-95eb-e6e8417da0bc]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:07 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e Jul 08 10:48:07 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:07 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5 1073741824" returned: 0 in 1.237s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:07 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5 Jul 08 10:48:07 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:07 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5" returned: 0 in 1.103s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:07 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5 Jul 08 10:48:07 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:08 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e" returned: 0 in 1.089s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:08 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e Jul 08 10:48:08 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:08 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5" returned: 0 in 0.875s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da752a4-d0c3-4481-a67e-4bc3b6070ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d5c024-960e-4c92-aa61-53cacf84d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:08 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Volume volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5 (c171835e-98e3-4b89-ab5a-cbb63382e0c5): created successfully Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d5c024-960e-4c92-aa61-53cacf84d10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Flow 'volume_create_manager' (fbab0fa9-f74a-4bf1-8857-5608b29d6ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:08 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-f6f7c396-f0f3-4867-8405-e860e937491a req-1e274262-d825-46fb-b9fa-a14b8335fdc6 tempest-VolumesGetTestJSON-633756274 None] Created volume successfully. Jul 08 10:48:08 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5" returned: 0 in 0.796s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Lock "cinder-quobyte-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5" released by "delete_volume" :: held 1.979s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Created reservations ['6c7a3382-e855-4417-a6d8-ad9f390a901e', '2d0a3377-1494-4840-a5f1-990cf90a8d55', 'c0235134-e14b-4e69-bf38-df0eb639c526', '6fbcb962-d8a4-4899-93fe-cde40cf584f3'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:08 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:08 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:08 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e" returned: 0 in 0.796s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Lock "cinder-quobyte-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e" released by "delete_volume" :: held 1.992s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:08 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Created reservations ['d52c9e13-8ba0-42d5-8601-66b1f33f6ce2', 'ec8addaf-a657-4bec-81f7-941e5efd457b', '3956e57d-c514-4ea3-aca3-8b5d9c47282d', '5c2a198d-289a-40ee-bc05-af293e421bc2'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:09 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:09 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:09 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.919s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Deleted volume successfully. Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=88,cinder:INSERT=32,cinder:UPDATE=97,cinder:DELETE=7 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dad25729-4e33-4607-af9c-d75352478634 tempest-VolumesCloneTest-1992171752 None] Lock "cinder-58e4d1f0-e7db-41c9-940b-5ea8b0be03c5-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Acquiring lock "cinder-c171835e-98e3-4b89-ab5a-cbb63382e0c5-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Lock "cinder-c171835e-98e3-4b89-ab5a-cbb63382e0c5-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=79,cinder:UPDATE=108,cinder:DELETE=9,cinder:INSERT=26 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Acquiring lock "cinder-quobyte-c171835e-98e3-4b89-ab5a-cbb63382e0c5" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Lock "cinder-quobyte-c171835e-98e3-4b89-ab5a-cbb63382e0c5" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee1c49e-3992-492d-bb54-b7b89b369663]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:10 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.076s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:10 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Deleted volume successfully. Jul 08 10:48:10 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5 Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:48:10 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Flow 'volume_create_manager' (00af9526-cb5c-480a-81c6-24b8595a915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bae0b8-bce2-4e43-8d45-2ccd6cae7038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b7f9791d-f063-4336-ad9c-f7a9addc8689 tempest-VolumesTransfersV355Test-1426554391 None] Lock "cinder-0ec3ce67-ee66-4ffd-86dc-ed3dee562d1e-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bae0b8-bce2-4e43-8d45-2ccd6cae7038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-235573204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33702b58-4aeb-479d-83ad-7a000bede4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd98c1b9650544aba7b43ffa0b27d8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:10Z,use_quota=True,user_id='ec4a81ecdf9a495aa311ad48bb57b2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbd182f-0c68-4e85-8d60-65ce0c0874a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbd182f-0c68-4e85-8d60-65ce0c0874a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272797d2-2b18-462d-bc40-d5e307cbf9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272797d2-2b18-462d-bc40-d5e307cbf9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33702b58-4aeb-479d-83ad-7a000bede4d9', 'volume_name': 'volume-33702b58-4aeb-479d-83ad-7a000bede4d9', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32d076c-bafe-4178-88f8-6d29b157a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32d076c-bafe-4178-88f8-6d29b157a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543e970d-57fc-47e1-b849-30d7e7982e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:10 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Volume 33702b58-4aeb-479d-83ad-7a000bede4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33702b58-4aeb-479d-83ad-7a000bede4d9', 'volume_size': 1} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-235573204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33702b58-4aeb-479d-83ad-7a000bede4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd98c1b9650544aba7b43ffa0b27d8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:10Z,use_quota=True,user_id='ec4a81ecdf9a495aa311ad48bb57b2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Creating volume 33702b58-4aeb-479d-83ad-7a000bede4d9 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:10 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:10 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9 1073741824 Jul 08 10:48:10 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:10 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5" returned: 0 in 0.924s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:10 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5 Jul 08 10:48:10 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:11 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9 1073741824" returned: 0 in 1.113s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:11 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9 Jul 08 10:48:11 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:11 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c171835e-98e3-4b89-ab5a-cbb63382e0c5" returned: 0 in 0.768s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Lock "cinder-quobyte-c171835e-98e3-4b89-ab5a-cbb63382e0c5" released by "delete_volume" :: held 1.744s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:11 devstack cinder-volume[86913]: DEBUG cinder.quota [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Created reservations ['b86f1ae9-7ff6-49c7-b52b-f08f9e51a31f', '1ecf25ab-6451-4669-b5ac-c2c0e81032de', '3dd8a9a3-f90b-4f41-b0aa-5ea09f50a1fb', 'd2793096-aaed-46d5-9ec3-d108c0eb3fdc'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:11 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:11 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:12 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9" returned: 0 in 0.727s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543e970d-57fc-47e1-b849-30d7e7982e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33702b58-4aeb-479d-83ad-7a000bede4d9', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f55716d-1d11-4eea-877d-6e69e999caad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:12 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Volume volume-33702b58-4aeb-479d-83ad-7a000bede4d9 (33702b58-4aeb-479d-83ad-7a000bede4d9): created successfully Jul 08 10:48:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f55716d-1d11-4eea-877d-6e69e999caad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Flow 'volume_create_manager' (00af9526-cb5c-480a-81c6-24b8595a915d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:12 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-191b9347-f3e5-4270-bc65-de8fc27b2a65 tempest-VolumesTransfersV355Test-920401156 None] Created volume successfully. Jul 08 10:48:12 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.742s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:12 devstack cinder-volume[86913]: DEBUG cinder.manager [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:12 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Deleted volume successfully. Jul 08 10:48:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-5a2e5e83-0512-4ebd-a1fc-301a1863a4a6 req-4652c417-15f0-4ef5-9142-d851890bcc78 tempest-VolumesGetTestJSON-633756274 None] Lock "cinder-c171835e-98e3-4b89-ab5a-cbb63382e0c5-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Acquiring lock "cinder-33702b58-4aeb-479d-83ad-7a000bede4d9-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Lock "cinder-33702b58-4aeb-479d-83ad-7a000bede4d9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Flow 'volume_create_manager' (ed0714c1-c7d1-4982-971b-573f36639710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49ca26f-eb05-4c04-af9f-e1ba35b11e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49ca26f-eb05-4c04-af9f-e1ba35b11e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-137119352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f25593-0a37-4eac-bd13-cce5b7ab67b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e770817c5684f53a72490697f050d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:14Z,use_quota=True,user_id='095582b225e149d8965514c8e20848f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509fda9e-27c7-4502-bd8c-3312abfb1c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509fda9e-27c7-4502-bd8c-3312abfb1c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec01f232-9a30-4132-b600-9c05b900b8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec01f232-9a30-4132-b600-9c05b900b8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f25593-0a37-4eac-bd13-cce5b7ab67b8', 'volume_name': 'volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d406f5e-a26c-4933-85c2-6b7cad94a02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d406f5e-a26c-4933-85c2-6b7cad94a02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b154a83f-6758-4ee0-9f75-957a7ca77285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:13 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Volume 29f25593-0a37-4eac-bd13-cce5b7ab67b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8', 'volume_size': 1} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-137119352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f25593-0a37-4eac-bd13-cce5b7ab67b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e770817c5684f53a72490697f050d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:14Z,use_quota=True,user_id='095582b225e149d8965514c8e20848f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Creating volume 29f25593-0a37-4eac-bd13-cce5b7ab67b8 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:13 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:13 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8 1073741824 Jul 08 10:48:13 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Acquiring lock "cinder-quobyte-33702b58-4aeb-479d-83ad-7a000bede4d9" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Lock "cinder-quobyte-33702b58-4aeb-479d-83ad-7a000bede4d9" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eb9061-43e3-43bb-9527-7dbadde52265]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:13 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9 Jul 08 10:48:13 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:14 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8 1073741824" returned: 0 in 0.941s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:14 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9" returned: 0 in 0.877s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:14 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9 Jul 08 10:48:14 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:14 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8 Jul 08 10:48:14 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:15 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-33702b58-4aeb-479d-83ad-7a000bede4d9" returned: 0 in 0.670s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Lock "cinder-quobyte-33702b58-4aeb-479d-83ad-7a000bede4d9" released by "delete_volume" :: held 1.603s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:15 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8" returned: 0 in 0.725s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b154a83f-6758-4ee0-9f75-957a7ca77285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3a6adb-d2f0-40fa-9dbe-356871900f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Created reservations ['6ac82f28-95da-4c5b-9528-fc00db2e98b6', 'a719dc87-e9d7-417a-b34d-0249819effb0', '1e604e55-63ef-44cb-beb9-474d1f32c28f', '843b79c1-dbe4-4978-b618-71f07a26c8c0'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:15 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Volume volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8 (29f25593-0a37-4eac-bd13-cce5b7ab67b8): created successfully Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3a6adb-d2f0-40fa-9dbe-356871900f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Flow 'volume_create_manager' (ed0714c1-c7d1-4982-971b-573f36639710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:15 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3623b76f-9bb5-49e0-9577-586370ec2f1e tempest-VolumesListTestJSON-537276306 None] Created volume successfully. Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:15 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:15 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Flow 'volume_create_manager' (eb4f0a2d-96cf-48c1-85ce-e3150c897656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1156195-24ff-4285-8c90-d8cab93b5f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1156195-24ff-4285-8c90-d8cab93b5f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-232695023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b5b924-4d8a-4811-978e-06343871487a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e770817c5684f53a72490697f050d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:16Z,use_quota=True,user_id='095582b225e149d8965514c8e20848f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f72b3f-c5d5-47be-8e1c-cc80ac72498a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f72b3f-c5d5-47be-8e1c-cc80ac72498a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c3f4c8-e652-4029-8b8c-8452cf76a5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c3f4c8-e652-4029-8b8c-8452cf76a5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b5b924-4d8a-4811-978e-06343871487a', 'volume_name': 'volume-06b5b924-4d8a-4811-978e-06343871487a', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1a1cce-b39a-4dc4-b1f2-8dcc88edd517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1a1cce-b39a-4dc4-b1f2-8dcc88edd517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775732bf-3977-4e5a-a6dc-88412238f5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:16 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Volume 06b5b924-4d8a-4811-978e-06343871487a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b5b924-4d8a-4811-978e-06343871487a', 'volume_size': 1} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-232695023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b5b924-4d8a-4811-978e-06343871487a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e770817c5684f53a72490697f050d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:16Z,use_quota=True,user_id='095582b225e149d8965514c8e20848f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Creating volume 06b5b924-4d8a-4811-978e-06343871487a {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:16 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:16 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.886s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:16 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a 1073741824 Jul 08 10:48:16 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Deleted volume successfully. Jul 08 10:48:16 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e05e667-d03e-4856-b10c-e4a558e46411 tempest-VolumesTransfersV355Test-1426554391 None] Lock "cinder-33702b58-4aeb-479d-83ad-7a000bede4d9-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:17 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5e7cac64-1907-4231-8cf7-c72df6d780f3 tempest-GroupsTest-486679565 None] Group tempest-Group1-1089599256: creating Jul 08 10:48:17 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5e7cac64-1907-4231-8cf7-c72df6d780f3 tempest-GroupsTest-486679565 None] Group tempest-Group1-1089599256: created successfully Jul 08 10:48:17 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5e7cac64-1907-4231-8cf7-c72df6d780f3 tempest-GroupsTest-486679565 None] Create group completed successfully. Jul 08 10:48:17 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a 1073741824" returned: 0 in 1.128s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:17 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a Jul 08 10:48:17 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:18 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a" returned: 0 in 0.811s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775732bf-3977-4e5a-a6dc-88412238f5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b5b924-4d8a-4811-978e-06343871487a', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74914563-0e31-4d3e-a2ac-54670603d283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:18 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Volume volume-06b5b924-4d8a-4811-978e-06343871487a (06b5b924-4d8a-4811-978e-06343871487a): created successfully Jul 08 10:48:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74914563-0e31-4d3e-a2ac-54670603d283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Flow 'volume_create_manager' (eb4f0a2d-96cf-48c1-85ce-e3150c897656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f95cc1c8-e105-4663-bb8d-cffcacd474c1 tempest-VolumesListTestJSON-537276306 None] Created volume successfully. Jul 08 10:48:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3d5f2c7d-228b-4cce-a79a-59042a4c2e77 tempest-GroupsTest-486679565 None] Group tempest-Group2-914160026: creating Jul 08 10:48:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3d5f2c7d-228b-4cce-a79a-59042a4c2e77 tempest-GroupsTest-486679565 None] Group tempest-Group2-914160026: created successfully Jul 08 10:48:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3d5f2c7d-228b-4cce-a79a-59042a4c2e77 tempest-GroupsTest-486679565 None] Create group completed successfully. Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Flow 'volume_create_manager' (5573a5fe-12b8-45f4-bf11-d9fe372d64cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a387953a-5f04-4eb1-afd8-48f80a3da985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a387953a-5f04-4eb1-afd8-48f80a3da985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1907655981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5dbf977-076f-4080-a452-1fd805c7ccc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e770817c5684f53a72490697f050d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:20Z,use_quota=True,user_id='095582b225e149d8965514c8e20848f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd39e98-681c-4c5c-9300-f49d610c8c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd39e98-681c-4c5c-9300-f49d610c8c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205e0471-6250-4324-8762-a89546976ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205e0471-6250-4324-8762-a89546976ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5dbf977-076f-4080-a452-1fd805c7ccc5', 'volume_name': 'volume-b5dbf977-076f-4080-a452-1fd805c7ccc5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0247d8-97f7-494a-a2e4-954f3037e649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0247d8-97f7-494a-a2e4-954f3037e649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323fe10b-d720-4b81-8fb9-226511e73f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:20 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Volume b5dbf977-076f-4080-a452-1fd805c7ccc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5dbf977-076f-4080-a452-1fd805c7ccc5', 'volume_size': 1} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1907655981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5dbf977-076f-4080-a452-1fd805c7ccc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e770817c5684f53a72490697f050d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:20Z,use_quota=True,user_id='095582b225e149d8965514c8e20848f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Creating volume b5dbf977-076f-4080-a452-1fd805c7ccc5 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:20 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:20 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5 1073741824 Jul 08 10:48:20 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-2a562dd2-f5d7-43a5-bf9a-a5a1aa2552fb req-7bd6e982-791b-4aa6-bbc2-791237f7b584 tempest-AttachVolumeTestJSON-956411359 None] Terminate volume connection completed successfully. Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-2a562dd2-f5d7-43a5-bf9a-a5a1aa2552fb req-7bd6e982-791b-4aa6-bbc2-791237f7b584 tempest-AttachVolumeTestJSON-956411359 None] Deleting attachment cf816ce0-c6da-4d0b-afcd-9970430fc9d7. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Flow 'volume_create_manager' (204d066e-89b0-4f59-9095-cc4fd00fe3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649f7565-c892-4ea3-973a-334db450fd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649f7565-c892-4ea3-973a-334db450fd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1240000802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3e310dd-5ed3-4d63-ab74-021cb9d11357,host='devstack@QuobyteHD#QuobyteHD',id=58889fda-6524-4e2b-ad6a-77aac65fbab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf463602884728b9d6864ced40c069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:21Z,use_quota=True,user_id='56c0be2db713478f840ccbecda58b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfab63b2-900a-49e5-8246-0bcb681c1088),volume_type_id=bfab63b2-900a-49e5-8246-0bcb681c1088)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71774c7-208e-40bc-b203-184d8dcc11b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71774c7-208e-40bc-b203-184d8dcc11b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929b8f9b-75ef-466f-9256-7db6fb4c6d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929b8f9b-75ef-466f-9256-7db6fb4c6d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58889fda-6524-4e2b-ad6a-77aac65fbab7', 'volume_name': 'volume-58889fda-6524-4e2b-ad6a-77aac65fbab7', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fde04f-ee8f-424f-aa01-cab5736cdb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fde04f-ee8f-424f-aa01-cab5736cdb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9705be-3672-46c1-910e-db23da27bd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:20 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Volume 58889fda-6524-4e2b-ad6a-77aac65fbab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58889fda-6524-4e2b-ad6a-77aac65fbab7', 'volume_size': 1} Jul 08 10:48:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:21 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5 1073741824" returned: 0 in 1.034s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:21 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5 Jul 08 10:48:21 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:21 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5" returned: 0 in 0.703s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.252s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c3e310dd-5ed3-4d63-ab74-021cb9d11357,created_at=2026-07-08T08:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1240000802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3e310dd-5ed3-4d63-ab74-021cb9d11357,host='devstack@QuobyteHD#QuobyteHD',id=58889fda-6524-4e2b-ad6a-77aac65fbab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf463602884728b9d6864ced40c069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:21Z,use_quota=True,user_id='56c0be2db713478f840ccbecda58b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfab63b2-900a-49e5-8246-0bcb681c1088),volume_type_id=bfab63b2-900a-49e5-8246-0bcb681c1088)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Creating volume 58889fda-6524-4e2b-ad6a-77aac65fbab7 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:21 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323fe10b-d720-4b81-8fb9-226511e73f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5dbf977-076f-4080-a452-1fd805c7ccc5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdb29cb-f2b9-4610-b02e-66363bb3a0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:22 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7 1073741824 Jul 08 10:48:22 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:22 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Volume volume-b5dbf977-076f-4080-a452-1fd805c7ccc5 (b5dbf977-076f-4080-a452-1fd805c7ccc5): created successfully Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdb29cb-f2b9-4610-b02e-66363bb3a0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Flow 'volume_create_manager' (5573a5fe-12b8-45f4-bf11-d9fe372d64cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:22 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3b723539-b155-4193-8a09-355d5c8f2d1d tempest-VolumesListTestJSON-537276306 None] Created volume successfully. Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Flow 'volume_create_manager' (c4d4df8d-ae69-4dd2-9301-f0a21e5e4e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3979661-0360-4a0d-9fec-7643f0f105cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3979661-0360-4a0d-9fec-7643f0f105cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-258787498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69aa8cdd-a732-42fb-8a59-44b1eae792bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230771e837f845d999c84ef8d43bfa59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:23Z,use_quota=True,user_id='051f625a7ba14462990c633b32322627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402ac695-181d-4bef-9846-d302a9ea9cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402ac695-181d-4bef-9846-d302a9ea9cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd5ca4d-90c3-49d0-8c11-81109b0f0090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd5ca4d-90c3-49d0-8c11-81109b0f0090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69aa8cdd-a732-42fb-8a59-44b1eae792bb', 'volume_name': 'volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f7ff16-00fd-4bdf-ba9b-22a6173c4e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f7ff16-00fd-4bdf-ba9b-22a6173c4e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941d6156-32eb-45bd-97b4-7633a9d15964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:22 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Volume 69aa8cdd-a732-42fb-8a59-44b1eae792bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb', 'volume_size': 1} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:22 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7 1073741824" returned: 0 in 0.982s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:23 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7 Jul 08 10:48:23 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:23 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7" returned: 0 in 0.703s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-258787498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69aa8cdd-a732-42fb-8a59-44b1eae792bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230771e837f845d999c84ef8d43bfa59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:23Z,use_quota=True,user_id='051f625a7ba14462990c633b32322627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Creating volume 69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:23 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:23 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb 1073741824 Jul 08 10:48:23 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9705be-3672-46c1-910e-db23da27bd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58889fda-6524-4e2b-ad6a-77aac65fbab7', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d7b82c-ada5-44f6-9a7e-3cdc8387de11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:23 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Volume volume-58889fda-6524-4e2b-ad6a-77aac65fbab7 (58889fda-6524-4e2b-ad6a-77aac65fbab7): created successfully Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d7b82c-ada5-44f6-9a7e-3cdc8387de11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Flow 'volume_create_manager' (204d066e-89b0-4f59-9095-cc4fd00fe3de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:23 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8427c22d-ee66-4315-9505-82fe3fd32037 tempest-GroupsTest-486679565 None] Created volume successfully. Jul 08 10:48:24 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb 1073741824" returned: 0 in 0.987s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:24 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb Jul 08 10:48:24 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Acquiring lock "cinder-quobyte-58889fda-6524-4e2b-ad6a-77aac65fbab7" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Lock "cinder-quobyte-58889fda-6524-4e2b-ad6a-77aac65fbab7" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e61ab4d-09cc-4625-a9d2-213b3d082c96]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:25 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7 Jul 08 10:48:25 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:25 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb" returned: 0 in 0.678s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941d6156-32eb-45bd-97b4-7633a9d15964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbd79f5-579f-4024-92a5-bf28f2dfbd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:25 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Volume volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb (69aa8cdd-a732-42fb-8a59-44b1eae792bb): created successfully Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbd79f5-579f-4024-92a5-bf28f2dfbd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Flow 'volume_create_manager' (c4d4df8d-ae69-4dd2-9301-f0a21e5e4e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Acquiring lock "cinder-b5dbf977-076f-4080-a452-1fd805c7ccc5-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:25 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-65d6a819-e2c9-4f04-b210-6d3794dd3ff3 tempest-VolumesSnapshotListTestJSON-820328877 None] Created volume successfully. Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-b5dbf977-076f-4080-a452-1fd805c7ccc5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Acquiring lock "cinder-quobyte-b5dbf977-076f-4080-a452-1fd805c7ccc5" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-quobyte-b5dbf977-076f-4080-a452-1fd805c7ccc5" acquired by "delete_volume" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af1de2-3780-4685-845c-96ffeb894f9d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:25 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5 Jul 08 10:48:25 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:25 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7" returned: 0 in 0.913s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:25 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7 Jul 08 10:48:25 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] Creating offline snapshot 5f72bf0c-e0fa-42c0-a575-22b9e0daae01 of volume 69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:48:26 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1e07dc-4144-4285-82d4-bd57c6f702b7]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:26 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb Jul 08 10:48:26 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:26 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5" returned: 0 in 0.961s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:26 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5 Jul 08 10:48:26 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:26 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58889fda-6524-4e2b-ad6a-77aac65fbab7" returned: 0 in 0.792s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Lock "cinder-quobyte-58889fda-6524-4e2b-ad6a-77aac65fbab7" released by "delete_volume" :: held 1.766s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:26 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Created reservations ['5bf44f55-8537-4c70-9e2c-b7352b510905'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:26 devstack cinder-volume[86913]: WARNING cinder.quota [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1431680125 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1431680125, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:48:26 devstack cinder-volume[86913]: WARNING cinder.quota [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1431680125 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1431680125, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:48:26 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Created reservations ['d511875e-9455-4eaf-b666-509db5d6d275', '4c101831-30d9-4fe6-a1fa-d2bc7e31368c', 'a2357b14-260d-47a6-8fc9-72b247a23931', 'ea69c8ed-e92b-4b10-8d47-288d73b26b4e'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:27 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:27 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:27 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb" returned: 0 in 0.987s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:27 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 1G Jul 08 10:48:27 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:27 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b5dbf977-076f-4080-a452-1fd805c7ccc5" returned: 0 in 0.967s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-quobyte-b5dbf977-076f-4080-a452-1fd805c7ccc5" released by "delete_volume" :: held 1.967s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-51ead12e-1589-4aca-9952-c94b075990c5 tempest-GroupsTest-486679565 None] Created reservations ['f3b2375c-9f41-4313-86e5-7ed7e4ab9c1c'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Created reservations ['84bc518f-d867-4bbb-bdd3-7631d09268fe', '9dfd1c17-1ed9-46d7-8015-cf3b35580b50', 'd7bdd4ed-61ee-4b92-95c5-79ad0b471e84', '9f767b94-1ad2-4339-97b1-648b388c2e0d'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51ead12e-1589-4aca-9952-c94b075990c5 tempest-GroupsTest-486679565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51ead12e-1589-4aca-9952-c94b075990c5 tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-51ead12e-1589-4aca-9952-c94b075990c5 tempest-GroupsTest-486679565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-51ead12e-1589-4aca-9952-c94b075990c5 tempest-GroupsTest-486679565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51ead12e-1589-4aca-9952-c94b075990c5 tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51ead12e-1589-4aca-9952-c94b075990c5 tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:27 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:27 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:27 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:27 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:27 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.835s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:27 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1b97aa93-4973-4874-bfec-bbb7c4cf8875 tempest-GroupsTest-486679565 None] Delete group completed successfully. Jul 08 10:48:28 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 1G" returned: 0 in 0.990s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:28 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 Jul 08 10:48:28 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:28 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51ead12e-1589-4aca-9952-c94b075990c5 tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.802s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:28 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-51ead12e-1589-4aca-9952-c94b075990c5 tempest-GroupsTest-486679565 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:28 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-51ead12e-1589-4aca-9952-c94b075990c5 tempest-GroupsTest-486679565 None] Delete group completed successfully. Jul 08 10:48:28 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.766s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:28 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:28 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Deleted volume successfully. Jul 08 10:48:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-32525519-e9e2-4895-8ac9-96f73ca8ee96 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-b5dbf977-076f-4080-a452-1fd805c7ccc5-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Acquiring lock "cinder-06b5b924-4d8a-4811-978e-06343871487a-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-06b5b924-4d8a-4811-978e-06343871487a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Acquiring lock "cinder-quobyte-06b5b924-4d8a-4811-978e-06343871487a" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-quobyte-06b5b924-4d8a-4811-978e-06343871487a" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:29 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c1a41d-a94e-4e2a-a542-ee66d0472f73]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:29 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01" returned: 0 in 0.842s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:29 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 is being set with open permissions: ugo+rw Jul 08 10:48:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:29 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 Jul 08 10:48:29 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:29 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a Jul 08 10:48:29 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c8f97d85-e547-4ec5-a94b-751d830d31f3 tempest-GroupsTest-486679565 None] Group tempest-GroupsTest-Group-852494785: creating Jul 08 10:48:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c8f97d85-e547-4ec5-a94b-751d830d31f3 tempest-GroupsTest-486679565 None] Group tempest-GroupsTest-Group-852494785: created successfully Jul 08 10:48:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c8f97d85-e547-4ec5-a94b-751d830d31f3 tempest-GroupsTest-486679565 None] Create group completed successfully. Jul 08 10:48:29 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01" returned: 0 in 0.898s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:30 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.info Jul 08 10:48:30 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:30 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a" returned: 0 in 0.995s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:30 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a Jul 08 10:48:30 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:30 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.info" returned: 0 in 0.745s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:30 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.info is being set with open permissions: ugo+rw Jul 08 10:48:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:30 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:30 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.info Jul 08 10:48:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-06b5b924-4d8a-4811-978e-06343871487a" returned: 0 in 0.744s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:30 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-quobyte-06b5b924-4d8a-4811-978e-06343871487a" released by "delete_volume" :: held 1.794s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:30 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Created reservations ['828681f3-4571-46d6-abdc-cfe05f7a3a16', 'bef8baa6-0316-4116-8ee1-9794dc4bfc1d', '22b21956-7ae6-47c2-999e-abadd7705f73', '55b0c49d-9cf0-4149-826d-42f962a5f758'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Flow 'volume_create_manager' (c5d3b181-bbb9-4fb0-9db4-bc97b0626344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d497bc-de88-443a-a1b3-4ce426dd5afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d497bc-de88-443a-a1b3-4ce426dd5afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-421280043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52d2db91-ea5d-4401-9448-ab549758b8bf,host='devstack@QuobyteHD#QuobyteHD',id=97e30db8-15a2-4370-b3fb-1fdaadccf5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf463602884728b9d6864ced40c069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:31Z,use_quota=True,user_id='56c0be2db713478f840ccbecda58b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f8e7e27-a71d-4fc8-b2a2-af0deaa08e18),volume_type_id=7f8e7e27-a71d-4fc8-b2a2-af0deaa08e18)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ad8f8c-17d1-4124-a219-3fdccca595bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:31 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:31 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ad8f8c-17d1-4124-a219-3fdccca595bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb6a45a-9f6d-403a-b9c7-ed57f9608423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb6a45a-9f6d-403a-b9c7-ed57f9608423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e30db8-15a2-4370-b3fb-1fdaadccf5e0', 'volume_name': 'volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d03ebb-2ed0-4ba2-8b3e-63fcd9323613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d03ebb-2ed0-4ba2-8b3e-63fcd9323613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5498d9ee-20f2-40cf-a2bb-074de9754f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:31 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Volume 97e30db8-15a2-4370-b3fb-1fdaadccf5e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0', 'volume_size': 1} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Acquiring lock "cinder-29f25593-0a37-4eac-bd13-cce5b7ab67b8-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-29f25593-0a37-4eac-bd13-cce5b7ab67b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Acquiring lock "cinder-quobyte-29f25593-0a37-4eac-bd13-cce5b7ab67b8" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-quobyte-29f25593-0a37-4eac-bd13-cce5b7ab67b8" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8715f520-4820-472b-b6c7-7b14601a92fc]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:31 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.info" returned: 0 in 0.802s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.384s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.372s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=52d2db91-ea5d-4401-9448-ab549758b8bf,created_at=2026-07-08T08:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-421280043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52d2db91-ea5d-4401-9448-ab549758b8bf,host='devstack@QuobyteHD#QuobyteHD',id=97e30db8-15a2-4370-b3fb-1fdaadccf5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf463602884728b9d6864ced40c069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:31Z,use_quota=True,user_id='56c0be2db713478f840ccbecda58b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f8e7e27-a71d-4fc8-b2a2-af0deaa08e18),volume_type_id=7f8e7e27-a71d-4fc8-b2a2-af0deaa08e18)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Creating volume 97e30db8-15a2-4370-b3fb-1fdaadccf5e0 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:31 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:31 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8 Jul 08 10:48:31 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:31 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0 1073741824 Jul 08 10:48:31 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:31 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0859ae7a-748b-48f5-a5ce-1e05ef7929c8 tempest-VolumesSnapshotListTestJSON-820328877 None] Create snapshot completed successfully Jul 08 10:48:31 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.803s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:31 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Deleted volume successfully. Jul 08 10:48:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0651963b-d0e9-402a-9e59-f726f6cab380 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-06b5b924-4d8a-4811-978e-06343871487a-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:32 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8" returned: 0 in 0.874s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:32 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8 Jul 08 10:48:32 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:32 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0 1073741824" returned: 0 in 1.011s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:32 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0 Jul 08 10:48:32 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:33 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-29f25593-0a37-4eac-bd13-cce5b7ab67b8" returned: 0 in 1.219s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-quobyte-29f25593-0a37-4eac-bd13-cce5b7ab67b8" released by "delete_volume" :: held 2.210s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:33 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Created reservations ['c524d220-b958-47ca-b1e2-71585b543467', '1c66501d-a194-4928-80a1-ce3cf4120ab1', 'aca27bd3-1760-4b79-a0bf-a0ad3283026b', '2180d27e-bbab-4525-82ac-f050ebdbb270'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:33 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0" returned: 0 in 1.185s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5498d9ee-20f2-40cf-a2bb-074de9754f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21405837-3347-4c68-a359-61e50bda95b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:34 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Volume volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0 (97e30db8-15a2-4370-b3fb-1fdaadccf5e0): created successfully Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21405837-3347-4c68-a359-61e50bda95b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Flow 'volume_create_manager' (c5d3b181-bbb9-4fb0-9db4-bc97b0626344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] Creating offline snapshot f9dabacf-0137-4016-a00d-9d26498df4a2 of volume 69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:48:34 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-523f2bb1-9987-4a85-aef7-52ed5215ecff tempest-GroupsTest-486679565 None] Created volume successfully. Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d914f7-3055-47d1-8c07-580dff7cfb65]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:34 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:34 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:34 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 Jul 08 10:48:34 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:35 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.869s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:35 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:35 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Deleted volume successfully. Jul 08 10:48:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eb07c93d-7cc0-4ce4-b5f3-d59e22efb829 tempest-VolumesListTestJSON-537276306 None] Lock "cinder-29f25593-0a37-4eac-bd13-cce5b7ab67b8-delete_volume" released by "delete_volume" :: held 3.736s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:35 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01" returned: 0 in 1.087s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:48:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:35 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 1G Jul 08 10:48:35 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:35 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:48:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Flow 'volume_create_manager' (6bfb32c3-89df-4e55-a4be-975abb6e308b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8157dd-832d-43c7-9f5b-cf28bed2137c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8157dd-832d-43c7-9f5b-cf28bed2137c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-70832373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52d2db91-ea5d-4401-9448-ab549758b8bf,host='devstack@QuobyteHD#QuobyteHD',id=70e30f54-3817-4108-affc-06234b65df93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf463602884728b9d6864ced40c069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:36Z,use_quota=True,user_id='56c0be2db713478f840ccbecda58b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f8e7e27-a71d-4fc8-b2a2-af0deaa08e18),volume_type_id=7f8e7e27-a71d-4fc8-b2a2-af0deaa08e18)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9ef3b7-89e5-46cd-b58e-f209b6170f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9ef3b7-89e5-46cd-b58e-f209b6170f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5782607-c015-4357-a54a-ebfc9c491b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5782607-c015-4357-a54a-ebfc9c491b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e30f54-3817-4108-affc-06234b65df93', 'volume_name': 'volume-70e30f54-3817-4108-affc-06234b65df93', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb05c7bb-cfc7-40dc-b6b9-033fe1261ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb05c7bb-cfc7-40dc-b6b9-033fe1261ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a6c2bb-cb4e-4138-9cde-7bf4ef6f58fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:36 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Volume 70e30f54-3817-4108-affc-06234b65df93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e30f54-3817-4108-affc-06234b65df93', 'volume_size': 1} Jul 08 10:48:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:36 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 1G" returned: 0 in 1.367s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:36 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 Jul 08 10:48:36 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:37 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2" returned: 0 in 1.071s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:37 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 is being set with open permissions: ugo+rw Jul 08 10:48:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:37 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 Jul 08 10:48:37 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:38 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2" returned: 0 in 0.859s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.676s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.500s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=52d2db91-ea5d-4401-9448-ab549758b8bf,created_at=2026-07-08T08:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-70832373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52d2db91-ea5d-4401-9448-ab549758b8bf,host='devstack@QuobyteHD#QuobyteHD',id=70e30f54-3817-4108-affc-06234b65df93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf463602884728b9d6864ced40c069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:36Z,use_quota=True,user_id='56c0be2db713478f840ccbecda58b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f8e7e27-a71d-4fc8-b2a2-af0deaa08e18),volume_type_id=7f8e7e27-a71d-4fc8-b2a2-af0deaa08e18)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Creating volume 70e30f54-3817-4108-affc-06234b65df93 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:38 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:38 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93 1073741824 Jul 08 10:48:38 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:38 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-7c046474-5e07-4091-b4c5-dcf393836fa0 tempest-VolumesSnapshotListTestJSON-820328877 None] Create snapshot completed successfully Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Flow 'volume_create_manager' (25425f9e-3813-4c21-8b9d-6fd3a2ffc25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fd8305-ee98-4f9a-95f3-0e905c908d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fd8305-ee98-4f9a-95f3-0e905c908d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1216568432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336a16b0-5851-48d0-9566-6ee75125fe75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b4f7264c4440999bd3fd1684d93baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:39Z,use_quota=True,user_id='98a7185d0b6a4ff1b3cfc8c5d5bb7432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5bdf6e-98ef-4fa7-b637-25088f3e8451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5bdf6e-98ef-4fa7-b637-25088f3e8451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6635ee8-4e7c-4bf3-9b97-eea334bbddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6635ee8-4e7c-4bf3-9b97-eea334bbddff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336a16b0-5851-48d0-9566-6ee75125fe75', 'volume_name': 'volume-336a16b0-5851-48d0-9566-6ee75125fe75', 'volume_size': 2}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41afe63d-4191-439c-93ca-256b176cd657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41afe63d-4191-439c-93ca-256b176cd657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b742b0-fa0c-48af-97de-02873a714a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:39 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Volume 336a16b0-5851-48d0-9566-6ee75125fe75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336a16b0-5851-48d0-9566-6ee75125fe75', 'volume_size': 2} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:39 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93 1073741824" returned: 0 in 1.102s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:39 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93 Jul 08 10:48:39 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:40 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93" returned: 0 in 0.641s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1216568432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336a16b0-5851-48d0-9566-6ee75125fe75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b4f7264c4440999bd3fd1684d93baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:39Z,use_quota=True,user_id='98a7185d0b6a4ff1b3cfc8c5d5bb7432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Creating volume 336a16b0-5851-48d0-9566-6ee75125fe75 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:40 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 2147483648 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a6c2bb-cb4e-4138-9cde-7bf4ef6f58fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e30f54-3817-4108-affc-06234b65df93', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4904ecd2-9b66-4b2a-92e1-0355e6bfa7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:40 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 2147483648 Jul 08 10:48:40 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:40 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Volume volume-70e30f54-3817-4108-affc-06234b65df93 (70e30f54-3817-4108-affc-06234b65df93): created successfully Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4904ecd2-9b66-4b2a-92e1-0355e6bfa7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Flow 'volume_create_manager' (6bfb32c3-89df-4e55-a4be-975abb6e308b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d5c539dd-545d-4550-97de-156b151046ae tempest-GroupsTest-486679565 None] Created volume successfully. Jul 08 10:48:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-80dea6ce-1110-45f2-8660-aa46b12b5a3b tempest-GroupsTest-486679565 None] Update group completed successfully. Jul 08 10:48:41 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 2147483648" returned: 0 in 0.912s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:41 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 Jul 08 10:48:41 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:41 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75" returned: 0 in 0.661s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.540s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b742b0-fa0c-48af-97de-02873a714a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336a16b0-5851-48d0-9566-6ee75125fe75', 'volume_size': 2}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98814eed-7765-450b-825f-8540cb268c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] Creating offline snapshot cc321e10-862b-4699-b02a-ccf01f7bc1ee of volume 69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:48:42 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Volume volume-336a16b0-5851-48d0-9566-6ee75125fe75 (336a16b0-5851-48d0-9566-6ee75125fe75): created successfully Jul 08 10:48:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98814eed-7765-450b-825f-8540cb268c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Flow 'volume_create_manager' (25425f9e-3813-4c21-8b9d-6fd3a2ffc25c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:42 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89dfb3f-12ca-49bc-a1bd-fc163771c99e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:42 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-bb331069-b65e-44d3-a1ba-d642a0fef2e5 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Created volume successfully. Jul 08 10:48:42 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 Jul 08 10:48:42 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:42 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-73b8cf20-9931-49fd-b261-8f654b320a21 tempest-GroupsTest-486679565 None] Update group completed successfully. Jul 08 10:48:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:43 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2" returned: 0 in 0.933s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:48:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:43 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee 1G Jul 08 10:48:43 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:43 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee 1G" returned: 0 in 0.942s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:44 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee Jul 08 10:48:44 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Acquiring lock "cinder-quobyte-70e30f54-3817-4108-affc-06234b65df93" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Lock "cinder-quobyte-70e30f54-3817-4108-affc-06234b65df93" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:44 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9bea47-0f6d-48cd-a16d-bb97228cf6a5]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:44 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93 Jul 08 10:48:44 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:44 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee" returned: 0 in 0.914s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:44 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee is being set with open permissions: ugo+rw Jul 08 10:48:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:44 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee Jul 08 10:48:44 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:45 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93" returned: 0 in 1.022s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:45 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93 Jul 08 10:48:45 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:45 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee" returned: 0 in 0.720s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.666s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.789s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Creating offline snapshot 0ae9551b-eecd-4db2-9496-8a0606b6c9bc of volume 336a16b0-5851-48d0-9566-6ee75125fe75 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:48:45 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fb00ca-ba2b-4715-8d3a-a4961abf410a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:45 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4b313fb8-69e1-4c20-a215-331dbb4e5113 tempest-VolumesSnapshotListTestJSON-820328877 None] Create snapshot completed successfully Jul 08 10:48:45 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 Jul 08 10:48:45 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:46 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-70e30f54-3817-4108-affc-06234b65df93" returned: 0 in 0.752s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Lock "cinder-quobyte-70e30f54-3817-4108-affc-06234b65df93" released by "delete_volume" :: held 1.819s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Acquiring lock "cinder-quobyte-97e30db8-15a2-4370-b3fb-1fdaadccf5e0" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Lock "cinder-quobyte-97e30db8-15a2-4370-b3fb-1fdaadccf5e0" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:46 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ce738a-c9cb-4f76-8842-d5769a47ee24]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:46 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0 Jul 08 10:48:46 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:46 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75" returned: 0 in 0.903s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc 2G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:46 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc 2G Jul 08 10:48:46 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:47 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0" returned: 0 in 0.955s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:47 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0 Jul 08 10:48:47 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:47 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97e30db8-15a2-4370-b3fb-1fdaadccf5e0" returned: 0 in 0.741s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:47 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Lock "cinder-quobyte-97e30db8-15a2-4370-b3fb-1fdaadccf5e0" released by "delete_volume" :: held 1.746s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc 2G" returned: 0 in 1.175s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "cinder-cc321e10-862b-4699-b02a-ccf01f7bc1ee-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336a16b0-5851-48d0-9566-6ee75125fe75 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:47 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336a16b0-5851-48d0-9566-6ee75125fe75 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc Jul 08 10:48:47 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-cc321e10-862b-4699-b02a-ccf01f7bc1ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "cinder-quobyte-cc321e10-862b-4699-b02a-ccf01f7bc1ee" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-cc321e10-862b-4699-b02a-ccf01f7bc1ee" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Deleting offline snapshot cc321e10-862b-4699-b02a-ccf01f7bc1ee of volume 69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] snapshot_file for this snap is: volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8117d15-7992-4320-b888-1c1b91b61517]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:47 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Created reservations ['dfd07750-83c9-48de-bbb6-fa36f280c8bd'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:48 devstack cinder-volume[86913]: WARNING cinder.quota [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2056149924 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2056149924, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:48:48 devstack cinder-volume[86913]: WARNING cinder.quota [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2056149924 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2056149924, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Created reservations ['1093f64d-cc77-44b7-90ba-f43c772304be', '61e3bcd0-7d86-4aac-a613-c79d3651686e', '46879880-f8b3-49f2-abe8-535b0c2d8606', 'eb96462c-c7aa-4fb1-97be-c298669815a4'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:48 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee Jul 08 10:48:48 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Created reservations ['657b28b5-3254-4cb8-b945-3cf3131c2be6', 'ec8ca4cd-ea52-458f-b5ff-7ab8daff27cc', 'f3c35fa9-4959-4020-9c8d-fb834e4dee2b', '26689da0-9dba-4fbb-bb6c-38fd60e34c9b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:48 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:48 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:48 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336a16b0-5851-48d0-9566-6ee75125fe75 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc" returned: 0 in 0.830s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:48 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc is being set with open permissions: ugo+rw Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:48 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc Jul 08 10:48:48 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:48 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee" returned: 0 in 0.817s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4c2e23-4187-4e5a-9fc2-88467d971347]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:48 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 Jul 08 10:48:48 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:49 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.766s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:49 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:49 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5515e70e-4b47-4467-8c24-9faeacca467e tempest-GroupsTest-486679565 None] Delete group completed successfully. Jul 08 10:48:49 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc" returned: 0 in 0.713s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:49 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.info Jul 08 10:48:49 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:49 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2" returned: 0 in 0.910s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:48:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:49 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee Jul 08 10:48:49 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:50 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.info" returned: 0 in 0.669s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:50 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.info is being set with open permissions: ugo+rw Jul 08 10:48:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:50 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.info Jul 08 10:48:50 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:50 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee" returned: 0 in 0.963s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:50 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee Jul 08 10:48:50 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:50 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.info" returned: 0 in 0.686s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.130s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:50 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1aef42ca-1a81-44d3-81d9-902790e9fd90 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Create snapshot completed successfully Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Acquiring lock "cinder-0ae9551b-eecd-4db2-9496-8a0606b6c9bc-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "cinder-0ae9551b-eecd-4db2-9496-8a0606b6c9bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Acquiring lock "cinder-quobyte-336a16b0-5851-48d0-9566-6ee75125fe75" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "cinder-quobyte-336a16b0-5851-48d0-9566-6ee75125fe75" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Acquiring lock "cinder-quobyte-0ae9551b-eecd-4db2-9496-8a0606b6c9bc" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "cinder-quobyte-0ae9551b-eecd-4db2-9496-8a0606b6c9bc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Deleting offline snapshot 0ae9551b-eecd-4db2-9496-8a0606b6c9bc of volume 336a16b0-5851-48d0-9566-6ee75125fe75 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:48:51 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] snapshot_file for this snap is: volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.cc321e10-862b-4699-b02a-ccf01f7bc1ee" returned: 0 in 0.770s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd6826d-40cd-40e3-a6c1-7549bb4f0e3c]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-cc321e10-862b-4699-b02a-ccf01f7bc1ee" released by "_delete_snapshot" :: held 3.581s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" released by "delete_snapshot" :: held 3.609s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Created reservations ['38ad37d3-6627-4428-81af-d0e381805000', 'ee926433-0eba-4938-824d-11cbf2fe9acc', '36839200-6485-4947-aa66-b0e0a022bfd0', '6766387a-5cbb-497f-b9b6-a0094292a42b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:51 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc Jul 08 10:48:51 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:51 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Delete snapshot completed successfully. Jul 08 10:48:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1fcbb07f-9f81-491b-a7b1-15f74c4b68d4 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-cc321e10-862b-4699-b02a-ccf01f7bc1ee-delete_snapshot" released by "delete_snapshot" :: held 3.841s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "cinder-f9dabacf-0137-4016-a00d-9d26498df4a2-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-f9dabacf-0137-4016-a00d-9d26498df4a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "cinder-quobyte-f9dabacf-0137-4016-a00d-9d26498df4a2" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-f9dabacf-0137-4016-a00d-9d26498df4a2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Deleting offline snapshot f9dabacf-0137-4016-a00d-9d26498df4a2 of volume 69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] snapshot_file for this snap is: volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e6a0d9-caf3-4302-b8c5-2c9f3a60ae8e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:52 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 Jul 08 10:48:52 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:52 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc" returned: 0 in 0.893s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-336a16b0-5851-48d0-9566-6ee75125fe75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b319bd82-60b8-43af-b744-b7b8e9878c52]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:52 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 Jul 08 10:48:52 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:53 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2" returned: 0 in 1.012s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b0cae4-4f51-4c45-917d-4aff3d7b9e28]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:53 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 Jul 08 10:48:53 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:53 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75" returned: 0 in 1.044s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:53 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc Jul 08 10:48:53 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:53 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:53 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:54 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01" returned: 0 in 0.969s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:48:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:54 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 Jul 08 10:48:54 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:54 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc" returned: 0 in 0.956s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:54 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc Jul 08 10:48:54 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:54 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.817s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:48:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:48:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:48:55 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2" returned: 0 in 0.941s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:55 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2 Jul 08 10:48:55 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:55 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6ceb6198-0f03-4788-9228-f72adaaedb1e tempest-GroupsV314Test-1208554590 None] Group tempest-GroupsV314Test-Group-756068188: creating Jul 08 10:48:55 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75.0ae9551b-eecd-4db2-9496-8a0606b6c9bc" returned: 0 in 0.775s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "cinder-quobyte-0ae9551b-eecd-4db2-9496-8a0606b6c9bc" released by "_delete_snapshot" :: held 3.840s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:55 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6ceb6198-0f03-4788-9228-f72adaaedb1e tempest-GroupsV314Test-1208554590 None] Group tempest-GroupsV314Test-Group-756068188: created successfully Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "cinder-quobyte-336a16b0-5851-48d0-9566-6ee75125fe75" released by "delete_snapshot" :: held 3.870s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:55 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6ceb6198-0f03-4788-9228-f72adaaedb1e tempest-GroupsV314Test-1208554590 None] Create group completed successfully. Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Created reservations ['51656d4f-28b4-4ce2-a754-b2897f85b248', '4178971e-3375-4c95-baf7-11623774304a', 'a6c8aa2d-2126-4e91-bec9-42581b9761df', '02cfb0e3-9533-44a8-89f9-7bed6f4ca937'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:55 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Delete snapshot completed successfully. Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ff5b824f-dd42-43a7-b57d-ede2889f6a86 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "cinder-0ae9551b-eecd-4db2-9496-8a0606b6c9bc-delete_snapshot" released by "delete_snapshot" :: held 4.022s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Acquiring lock "cinder-336a16b0-5851-48d0-9566-6ee75125fe75-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "cinder-336a16b0-5851-48d0-9566-6ee75125fe75-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Acquiring lock "cinder-quobyte-336a16b0-5851-48d0-9566-6ee75125fe75" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "cinder-quobyte-336a16b0-5851-48d0-9566-6ee75125fe75" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ff9cf7-1c00-4d83-9874-7113209a4c16]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:55 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.f9dabacf-0137-4016-a00d-9d26498df4a2" returned: 0 in 0.738s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-f9dabacf-0137-4016-a00d-9d26498df4a2" released by "_delete_snapshot" :: held 3.799s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" released by "delete_snapshot" :: held 3.827s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:55 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Created reservations ['ccebf3d6-eb63-46a9-a9d6-0798c5e5cbec', 'c5a31b87-f4dc-47d8-af05-817e6a660db2', 'e8a6950c-ec49-4f97-a446-ea57951324f5', '87f4ae55-4bf6-40c7-867e-fceb7ce764b3'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:56 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 Jul 08 10:48:56 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:56 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Delete snapshot completed successfully. Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-fc250afa-e2df-4357-a6f7-a5c42819bb77 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-f9dabacf-0137-4016-a00d-9d26498df4a2-delete_snapshot" released by "delete_snapshot" :: held 3.982s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "cinder-5f72bf0c-e0fa-42c0-a575-22b9e0daae01-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-5f72bf0c-e0fa-42c0-a575-22b9e0daae01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "cinder-quobyte-5f72bf0c-e0fa-42c0-a575-22b9e0daae01" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-5f72bf0c-e0fa-42c0-a575-22b9e0daae01" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Deleting offline snapshot 5f72bf0c-e0fa-42c0-a575-22b9e0daae01 of volume 69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] snapshot_file for this snap is: volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8752d80d-1f12-4f37-ab47-76fdcd8ef57e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:56 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 Jul 08 10:48:56 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:56 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75" returned: 0 in 0.813s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:56 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75 Jul 08 10:48:56 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:56 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Flow 'volume_create_manager' (570e88d2-9b9d-4773-b4f6-de5edd412a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf9bfd3-6bb9-41a7-b024-013578805935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf9bfd3-6bb9-41a7-b024-013578805935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-583269169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e00cdb44-0dcc-40b9-b07a-e836ba72f7cb,host='devstack@QuobyteHD#QuobyteHD',id=e917c412-b938-40ea-a7d6-3cd2d0df81c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6887aa8e2d104126b04f450be5a8d859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:57Z,use_quota=True,user_id='563c9334abf24a0bbcfde9bc64bcc0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6820bf4b-a83c-4007-939e-860d708639fc),volume_type_id=6820bf4b-a83c-4007-939e-860d708639fc)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc769a4d-b151-43db-b72a-6b8155747e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc769a4d-b151-43db-b72a-6b8155747e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358c73c2-7b30-4450-9c98-83c6bdb6cdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358c73c2-7b30-4450-9c98-83c6bdb6cdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e917c412-b938-40ea-a7d6-3cd2d0df81c0', 'volume_name': 'volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2115fd35-7057-4a33-8851-25af6400268d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2115fd35-7057-4a33-8851-25af6400268d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b968a704-e0cc-4eeb-a270-82c8081d38ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:57 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Volume e917c412-b938-40ea-a7d6-3cd2d0df81c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0', 'volume_size': 1} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e00cdb44-0dcc-40b9-b07a-e836ba72f7cb,created_at=2026-07-08T08:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-583269169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e00cdb44-0dcc-40b9-b07a-e836ba72f7cb,host='devstack@QuobyteHD#QuobyteHD',id=e917c412-b938-40ea-a7d6-3cd2d0df81c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6887aa8e2d104126b04f450be5a8d859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:48:57Z,use_quota=True,user_id='563c9334abf24a0bbcfde9bc64bcc0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6820bf4b-a83c-4007-939e-860d708639fc),volume_type_id=6820bf4b-a83c-4007-939e-860d708639fc)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Creating volume e917c412-b938-40ea-a7d6-3cd2d0df81c0 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:48:57 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:57 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 1073741824 Jul 08 10:48:57 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:57 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-336a16b0-5851-48d0-9566-6ee75125fe75" returned: 0 in 0.768s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "cinder-quobyte-336a16b0-5851-48d0-9566-6ee75125fe75" released by "delete_volume" :: held 1.671s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:57 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01" returned: 0 in 1.066s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b71b1-9dfd-4eb4-817f-12de11ce0fa4]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Created reservations ['ac02eba4-4c1c-4aab-aa32-4da90a8d4ceb', 'ca5d771b-3202-424a-9a63-b8c378511490', 'f99afcab-2b11-408a-b0d0-5fa79005d0e8', '05278557-4d44-4d44-a373-c7e0b3b747cd'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:57 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:48:57 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:57 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb Jul 08 10:48:57 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:58 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 1073741824" returned: 0 in 1.094s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:58 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 Jul 08 10:48:58 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:58 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.874s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:58 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:48:58 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Deleted volume successfully. Jul 08 10:48:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26d0d97c-65d9-45b3-bd31-d464a26667b0 tempest-VolumesSnapshotNegativeTestJSON-124909436 None] Lock "cinder-336a16b0-5851-48d0-9566-6ee75125fe75-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:48:58 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb" returned: 0 in 1.047s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:58 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 Jul 08 10:48:58 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:48:59 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0" returned: 0 in 0.824s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:48:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:48:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b968a704-e0cc-4eeb-a270-82c8081d38ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a050ce-bc5b-4694-b86d-faf14775fcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:48:59 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Volume volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 (e917c412-b938-40ea-a7d6-3cd2d0df81c0): created successfully Jul 08 10:48:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a050ce-bc5b-4694-b86d-faf14775fcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:48:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Flow 'volume_create_manager' (570e88d2-9b9d-4773-b4f6-de5edd412a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:48:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-849e588a-8662-4f77-b690-0d3b04fb2225 tempest-GroupsV314Test-1208554590 None] Created volume successfully. Jul 08 10:48:59 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 08 10:48:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01" returned: 0 in 0.995s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:48:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:48:59 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01 Jul 08 10:48:59 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:00 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb.5f72bf0c-e0fa-42c0-a575-22b9e0daae01" returned: 0 in 0.867s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-5f72bf0c-e0fa-42c0-a575-22b9e0daae01" released by "_delete_snapshot" :: held 4.127s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:49:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" released by "delete_snapshot" :: held 4.155s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:49:00 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Created reservations ['39341b48-4ef8-4d5e-9b5f-f03e2c1af29e', 'b5a49e5e-6e8c-41d0-9492-1c297d786e13', '097480f2-00e2-4f32-918e-4e47ac56d838', '7a66d0df-88bb-4e41-bbf3-1d86f184593d'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:49:00 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Delete snapshot completed successfully. Jul 08 10:49:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:00 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Cloning volume e917c412-b938-40ea-a7d6-3cd2d0df81c0 to volume cbc03b1b-7d10-4866-877b-e2c9c831e5b7 Jul 08 10:49:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-48d37c77-0fb7-4754-be0d-df79972a320d tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-5f72bf0c-e0fa-42c0-a575-22b9e0daae01-delete_snapshot" released by "delete_snapshot" :: held 4.518s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:49:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Creating offline snapshot d7b40f38-9696-4b58-8c8a-184f81ca1aaf of volume e917c412-b938-40ea-a7d6-3cd2d0df81c0 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:49:00 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cacbd6-48e5-4b0b-aa3c-5a11c571161b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:49:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:01 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 Jul 08 10:49:01 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "cinder-69aa8cdd-a732-42fb-8a59-44b1eae792bb-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:49:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-69aa8cdd-a732-42fb-8a59-44b1eae792bb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:49:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:49:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:49:02 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5aa088-6f7e-42df-a7e9-d1db3dddd302]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:49:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0" returned: 0 in 1.051s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:02 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf 1G Jul 08 10:49:02 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:02 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb Jul 08 10:49:02 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:02 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb" returned: 0 in 0.949s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:03 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb Jul 08 10:49:03 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:03 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf 1G" returned: 0 in 1.266s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:03 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf Jul 08 10:49:03 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:03 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69aa8cdd-a732-42fb-8a59-44b1eae792bb" returned: 0 in 0.817s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:03 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-quobyte-69aa8cdd-a732-42fb-8a59-44b1eae792bb" released by "delete_volume" :: held 1.841s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:49:03 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Created reservations ['168a995b-429a-4352-9f6b-cbbc77a03702', '5b31a4ab-d775-4632-8909-1c4ef26dc935', '34c94431-c62e-4bca-95b1-9328040ea3e6', '7d1616f7-da5d-49ad-b8bd-bedad61f35ab'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:49:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:49:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:49:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:03 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:49:03 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:04 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf" returned: 0 in 0.899s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:04 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:49:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:04 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf Jul 08 10:49:04 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:04 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.776s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:04 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:49:04 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Deleted volume successfully. Jul 08 10:49:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f805df6c-b197-44c0-9685-885540071495 tempest-VolumesSnapshotListTestJSON-820328877 None] Lock "cinder-69aa8cdd-a732-42fb-8a59-44b1eae792bb-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:49:05 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf" returned: 0 in 0.963s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:05 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.info Jul 08 10:49:05 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:06 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.info" returned: 0 in 0.820s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:06 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:06 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.info Jul 08 10:49:06 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:06 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.info" returned: 0 in 0.818s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Acquiring lock "cinder-quobyte-cbc03b1b-7d10-4866-877b-e2c9c831e5b7" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Lock "cinder-quobyte-cbc03b1b-7d10-4866-877b-e2c9c831e5b7" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] snapshot: d7b40f38-9696-4b58-8c8a-184f81ca1aaf, volume: cbc03b1b-7d10-4866-877b-e2c9c831e5b7, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ece3511-bdad-48be-a961-c950beb77bc0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:49:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:07 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf Jul 08 10:49:07 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:08 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf" returned: 0 in 1.099s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:49:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 10:49:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 10:49:08 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[48df29c3-e6a1-4498-9029-e0d7a6b59054]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:49:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:08 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 Jul 08 10:49:08 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:09 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0" returned: 0 in 1.016s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:09 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7 not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 10:49:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:09 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7 Jul 08 10:49:09 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:15 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=119,cinder:UPDATE=160,cinder:DELETE=8,cinder:INSERT=42 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:49:15 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=142,cinder:UPDATE=142,cinder:INSERT=31,cinder:DELETE=14 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:49:15 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7" returned: 0 in 6.314s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:15 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[57703e3f-ae0e-4a42-8731-9b9eb6b4c5a8]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:49:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:15 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 Jul 08 10:49:15 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:16 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0" returned: 0 in 1.250s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:16 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:49:16 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Converted 1024.00 MB image at 162.10 MB/s Jul 08 10:49:16 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:49:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:16 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7 Jul 08 10:49:16 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:17 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7" returned: 0 in 0.855s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Lock "cinder-quobyte-cbc03b1b-7d10-4866-877b-e2c9c831e5b7" released by "_copy_volume_from_snapshot" :: held 10.674s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:49:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Acquiring lock "cinder-quobyte-d7b40f38-9696-4b58-8c8a-184f81ca1aaf" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:49:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Lock "cinder-quobyte-d7b40f38-9696-4b58-8c8a-184f81ca1aaf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:49:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Deleting offline snapshot d7b40f38-9696-4b58-8c8a-184f81ca1aaf of volume e917c412-b938-40ea-a7d6-3cd2d0df81c0 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:49:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] snapshot_file for this snap is: volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:49:17 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b246c697-3234-4176-b5b2-f43c4447ff56]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:49:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:17 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf Jul 08 10:49:17 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:18 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf" returned: 0 in 0.975s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:49:18 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[db33367f-6e69-4b2c-bd11-9ab565c19ce0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:49:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:18 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 Jul 08 10:49:18 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:19 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0" returned: 0 in 1.123s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:19 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf Jul 08 10:49:19 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:20 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf" returned: 0 in 0.920s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:20 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf Jul 08 10:49:20 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:21 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0.d7b40f38-9696-4b58-8c8a-184f81ca1aaf" returned: 0 in 0.702s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Lock "cinder-quobyte-d7b40f38-9696-4b58-8c8a-184f81ca1aaf" released by "_delete_snapshot" :: held 3.866s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:49:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.608s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:21 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3fa3186e-babf-4758-938c-dc6b8c0ab75b tempest-GroupsV314Test-1208554590 None] Create group from source-group-e00cdb44-0dcc-40b9-b07a-e836ba72f7cb completed successfully. Jul 08 10:49:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Acquiring lock "cinder-quobyte-cbc03b1b-7d10-4866-877b-e2c9c831e5b7" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:49:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Lock "cinder-quobyte-cbc03b1b-7d10-4866-877b-e2c9c831e5b7" acquired by "delete_volume" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:49:23 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[050615a7-91e7-4d77-9409-630630274ba4]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:49:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:23 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7 Jul 08 10:49:23 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:24 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7" returned: 0 in 0.916s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:24 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7 Jul 08 10:49:24 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:25 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbc03b1b-7d10-4866-877b-e2c9c831e5b7" returned: 0 in 0.786s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Lock "cinder-quobyte-cbc03b1b-7d10-4866-877b-e2c9c831e5b7" released by "delete_volume" :: held 1.762s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:49:25 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Created reservations ['a2ee738d-6337-481a-8172-4dee7c5fd70d'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:49:25 devstack cinder-volume[86913]: WARNING cinder.quota [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-27125957 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-27125957, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:49:25 devstack cinder-volume[86913]: WARNING cinder.quota [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-27125957 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-27125957, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:49:25 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Created reservations ['ccb3dbdb-90d9-4719-8b21-fbff4adaf24d', '9d1c4562-ae8e-4ffd-899a-1a6a82f4f359', '459e29d1-ab1e-4923-a22c-25051b496905', '80563f7c-f7fc-44dc-8a31-35f9abbe5cbf'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:49:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:49:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:49:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:25 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:49:25 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:26 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.817s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:26 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:49:26 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b20546fc-56dc-48b0-a23b-7ae20a3a13e2 tempest-GroupsV314Test-1208554590 None] Delete group completed successfully. Jul 08 10:49:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Acquiring lock "cinder-quobyte-e917c412-b938-40ea-a7d6-3cd2d0df81c0" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:49:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Lock "cinder-quobyte-e917c412-b938-40ea-a7d6-3cd2d0df81c0" acquired by "delete_volume" :: waited 0.032s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:49:26 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0725735-6ac9-48f4-8e38-c4182b7d01b8]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:49:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:26 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 Jul 08 10:49:26 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:27 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0" returned: 0 in 0.928s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:27 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0 Jul 08 10:49:27 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:28 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e917c412-b938-40ea-a7d6-3cd2d0df81c0" returned: 0 in 0.800s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Lock "cinder-quobyte-e917c412-b938-40ea-a7d6-3cd2d0df81c0" released by "delete_volume" :: held 1.832s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:49:28 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Created reservations ['f2741a64-7a88-497e-b3d4-8d20b297e678'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:49:28 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Created reservations ['41f78a68-f03e-494b-8acc-3f15000b6881', 'd74e3355-321c-407c-b12f-7a8f26dc59bf', 'fae970ff-e988-46c6-a2d5-90aefb918586', '1b86565d-b124-4c46-be93-120cfc887850'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:49:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:49:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:49:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:28 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:49:28 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:29 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.108s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:29 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:49:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-39ec8cf1-85cb-41a4-809f-26afcff47536 tempest-GroupsV314Test-1208554590 None] Delete group completed successfully. Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Flow 'volume_create_manager' (5f4b1739-3175-47d7-9cf4-485f77a820a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491bf3d5-7d11-4335-a5be-678014a7a036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491bf3d5-7d11-4335-a5be-678014a7a036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-174750360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543a6ee4-6bd5-4e26-8078-d227d360a757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a830df29b16c4f8a995e14932f2b51ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:49:36Z,use_quota=True,user_id='a68d7cab464f4335a50483c7e646a5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b0f1fd-cf3c-4e2c-9ab1-5d80559a501f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b0f1fd-cf3c-4e2c-9ab1-5d80559a501f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4948e95-d4f0-42ef-9484-b95efb1e3a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4948e95-d4f0-42ef-9484-b95efb1e3a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '543a6ee4-6bd5-4e26-8078-d227d360a757', 'volume_name': 'volume-543a6ee4-6bd5-4e26-8078-d227d360a757', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04050b1-0db3-4bf1-ba85-684df7136109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04050b1-0db3-4bf1-ba85-684df7136109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bde43f-628e-40d7-bb14-c59c92b6de34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:36 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Volume 543a6ee4-6bd5-4e26-8078-d227d360a757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-543a6ee4-6bd5-4e26-8078-d227d360a757', 'volume_size': 1} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-174750360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543a6ee4-6bd5-4e26-8078-d227d360a757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a830df29b16c4f8a995e14932f2b51ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:49:36Z,use_quota=True,user_id='a68d7cab464f4335a50483c7e646a5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Creating volume 543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:49:36 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:49:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:36 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 1073741824 Jul 08 10:49:36 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:37 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 1073741824" returned: 0 in 1.262s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:37 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 Jul 08 10:49:37 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:38 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d2115cbe-9fc4-4c5b-96af-0d8b56093f77 tempest-GroupsV320Test-494329593 None] Group tempest-GroupsV320Test-Group-1224142360: creating Jul 08 10:49:38 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d2115cbe-9fc4-4c5b-96af-0d8b56093f77 tempest-GroupsV320Test-494329593 None] Group tempest-GroupsV320Test-Group-1224142360: created successfully Jul 08 10:49:38 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d2115cbe-9fc4-4c5b-96af-0d8b56093f77 tempest-GroupsV320Test-494329593 None] Create group completed successfully. Jul 08 10:49:38 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757" returned: 0 in 1.020s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] <== create_volume: return (2361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:49:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.363s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bde43f-628e-40d7-bb14-c59c92b6de34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-543a6ee4-6bd5-4e26-8078-d227d360a757', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf60618-5d3c-4114-863d-dabad47d4e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:38 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Volume volume-543a6ee4-6bd5-4e26-8078-d227d360a757 (543a6ee4-6bd5-4e26-8078-d227d360a757): created successfully Jul 08 10:49:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf60618-5d3c-4114-863d-dabad47d4e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Flow 'volume_create_manager' (5f4b1739-3175-47d7-9cf4-485f77a820a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:49:38 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-49e6a4a7-dbf8-44f3-b3ef-a88f3d18141a tempest-TestStampPattern-920917405 None] Created volume successfully. Jul 08 10:49:40 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-7e59b123-5ae4-4540-b2e2-18d12a7c633d tempest-GroupsV320Test-494329593 None] Created reservations ['91c3110f-95d8-4cd0-b200-1f981f765e6c'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:49:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7e59b123-5ae4-4540-b2e2-18d12a7c633d tempest-GroupsV320Test-494329593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7e59b123-5ae4-4540-b2e2-18d12a7c633d tempest-GroupsV320Test-494329593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7e59b123-5ae4-4540-b2e2-18d12a7c633d tempest-GroupsV320Test-494329593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:49:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7e59b123-5ae4-4540-b2e2-18d12a7c633d tempest-GroupsV320Test-494329593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:49:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7e59b123-5ae4-4540-b2e2-18d12a7c633d tempest-GroupsV320Test-494329593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7e59b123-5ae4-4540-b2e2-18d12a7c633d tempest-GroupsV320Test-494329593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:40 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:49:40 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:41 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7e59b123-5ae4-4540-b2e2-18d12a7c633d tempest-GroupsV320Test-494329593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.860s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:41 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-7e59b123-5ae4-4540-b2e2-18d12a7c633d tempest-GroupsV320Test-494329593 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:49:41 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-7e59b123-5ae4-4540-b2e2-18d12a7c633d tempest-GroupsV320Test-494329593 None] Delete group completed successfully. Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Flow 'volume_create_manager' (f1f7ba72-7183-4384-a346-0aee96a8cd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c69ada-734f-4abf-8ffa-2438bd840664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c69ada-734f-4abf-8ffa-2438bd840664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-719352008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1826b60-8d8f-4adb-af83-05cac3be2f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95fe2c32ada749b5818eff242c67dca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:49:43Z,use_quota=True,user_id='75a0a2b219934d09821215d196a47aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12b8500-f8f8-4d20-ad40-aed97b81d27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12b8500-f8f8-4d20-ad40-aed97b81d27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7ad38f-6fce-4d24-9250-b0eb0337adfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7ad38f-6fce-4d24-9250-b0eb0337adfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1826b60-8d8f-4adb-af83-05cac3be2f94', 'volume_name': 'volume-e1826b60-8d8f-4adb-af83-05cac3be2f94', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a568b77c-97bb-4a01-accb-1a90017462c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a568b77c-97bb-4a01-accb-1a90017462c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602f7853-6f70-43e5-be53-768929feda2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:42 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Volume e1826b60-8d8f-4adb-af83-05cac3be2f94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1826b60-8d8f-4adb-af83-05cac3be2f94', 'volume_size': 1} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-719352008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1826b60-8d8f-4adb-af83-05cac3be2f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95fe2c32ada749b5818eff242c67dca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:49:43Z,use_quota=True,user_id='75a0a2b219934d09821215d196a47aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Creating volume e1826b60-8d8f-4adb-af83-05cac3be2f94 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:49:42 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:49:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:42 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 1073741824 Jul 08 10:49:42 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Flow 'volume_create_manager' (5a79b07b-36dd-4358-9202-13649ddedcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bd6030-0bdc-477f-8538-43409e3a4e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bd6030-0bdc-477f-8538-43409e3a4e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-240950017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d821fe-bc0d-45ce-877b-73278d88acb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95fe2c32ada749b5818eff242c67dca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:49:43Z,use_quota=True,user_id='75a0a2b219934d09821215d196a47aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88f7e45-1bf9-4999-b17e-8dffc99f1e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88f7e45-1bf9-4999-b17e-8dffc99f1e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80475cd-8198-4f7e-b032-5f8e5e818f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80475cd-8198-4f7e-b032-5f8e5e818f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d821fe-bc0d-45ce-877b-73278d88acb3', 'volume_name': 'volume-f7d821fe-bc0d-45ce-877b-73278d88acb3', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d01c24-03f0-4e2a-8220-019c9ad0d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d01c24-03f0-4e2a-8220-019c9ad0d898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f891059-0d46-4057-8383-ee713e222b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:43 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Volume f7d821fe-bc0d-45ce-877b-73278d88acb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d821fe-bc0d-45ce-877b-73278d88acb3', 'volume_size': 1} Jul 08 10:49:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:44 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 1073741824" returned: 0 in 1.488s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:44 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 Jul 08 10:49:44 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:45 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94" returned: 0 in 0.982s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] <== create_volume: return (2539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.546s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.799s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-240950017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d821fe-bc0d-45ce-877b-73278d88acb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95fe2c32ada749b5818eff242c67dca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:49:43Z,use_quota=True,user_id='75a0a2b219934d09821215d196a47aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Creating volume f7d821fe-bc0d-45ce-877b-73278d88acb3 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:49:45 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602f7853-6f70-43e5-be53-768929feda2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1826b60-8d8f-4adb-af83-05cac3be2f94', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:45 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 1073741824 Jul 08 10:49:45 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe7c739-9a38-4f2b-b7b3-5462549af4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:45 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Volume volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 (e1826b60-8d8f-4adb-af83-05cac3be2f94): created successfully Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe7c739-9a38-4f2b-b7b3-5462549af4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:45 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Flow 'volume_create_manager' (f1f7ba72-7183-4384-a346-0aee96a8cd4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:49:45 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ec61caac-b77b-4c6c-bf4d-3d85978dcfa6 tempest-TestServerVolumeAttachmentScenario-247934715 None] Created volume successfully. Jul 08 10:49:46 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 1073741824" returned: 0 in 1.092s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:46 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 Jul 08 10:49:46 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:47 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3" returned: 0 in 1.312s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] <== create_volume: return (2461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:49:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.476s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f891059-0d46-4057-8383-ee713e222b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d821fe-bc0d-45ce-877b-73278d88acb3', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6228dc-0b43-4dbf-ad1a-bcfaddfbea05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:47 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Volume volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 (f7d821fe-bc0d-45ce-877b-73278d88acb3): created successfully Jul 08 10:49:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6228dc-0b43-4dbf-ad1a-bcfaddfbea05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Flow 'volume_create_manager' (5a79b07b-36dd-4358-9202-13649ddedcf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:49:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-734a47ed-d663-4717-9638-d08f47eb2557 tempest-TestServerVolumeAttachmentScenario-247934715 None] Created volume successfully. Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Flow 'volume_create_manager' (eb300268-4465-4a7c-ac06-8806a1e74fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911753ef-8b9d-4ffe-9c87-2bcb5389667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911753ef-8b9d-4ffe-9c87-2bcb5389667f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1271853008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60d2e70-562f-4c71-8665-3c3997942bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e997373f7764076ae300279a80f1391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:49:52Z,use_quota=True,user_id='7f2aaf7bfbd84d52b28fe06e6c7698de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6c77c1-76e0-413f-9250-7765b300c0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6c77c1-76e0-413f-9250-7765b300c0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c69f88-059d-4a3c-b38f-4c21d66cc4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c69f88-059d-4a3c-b38f-4c21d66cc4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b60d2e70-562f-4c71-8665-3c3997942bce', 'volume_name': 'volume-b60d2e70-562f-4c71-8665-3c3997942bce', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7bc302f-9f26-425f-8a80-702d002e911e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7bc302f-9f26-425f-8a80-702d002e911e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdcc3bb-ecb3-47be-963f-da1911870d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:52 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Volume b60d2e70-562f-4c71-8665-3c3997942bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b60d2e70-562f-4c71-8665-3c3997942bce', 'volume_size': 1} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1271853008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60d2e70-562f-4c71-8665-3c3997942bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e997373f7764076ae300279a80f1391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:49:52Z,use_quota=True,user_id='7f2aaf7bfbd84d52b28fe06e6c7698de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Creating volume b60d2e70-562f-4c71-8665-3c3997942bce {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:49:52 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:49:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:52 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce 1073741824 Jul 08 10:49:52 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:53 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce 1073741824" returned: 0 in 1.277s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:53 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce Jul 08 10:49:53 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:49:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:49:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:49:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:53 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:49:53 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:54 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.748s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:49:54 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce" returned: 0 in 0.992s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] <== create_volume: return (2317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.319s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdcc3bb-ecb3-47be-963f-da1911870d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b60d2e70-562f-4c71-8665-3c3997942bce', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9438c2d0-5952-4c78-bea1-df1a7430ed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:49:54 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Volume volume-b60d2e70-562f-4c71-8665-3c3997942bce (b60d2e70-562f-4c71-8665-3c3997942bce): created successfully Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9438c2d0-5952-4c78-bea1-df1a7430ed3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:49:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Flow 'volume_create_manager' (eb300268-4465-4a7c-ac06-8806a1e74fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:49:54 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-74055d9f-1745-4aea-92cc-de9b89f8ed19 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Created volume successfully. Jul 08 10:49:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Acquiring lock "cinder-b60d2e70-562f-4c71-8665-3c3997942bce-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:49:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "cinder-b60d2e70-562f-4c71-8665-3c3997942bce-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:49:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Acquiring lock "cinder-quobyte-b60d2e70-562f-4c71-8665-3c3997942bce" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:49:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "cinder-quobyte-b60d2e70-562f-4c71-8665-3c3997942bce" acquired by "delete_volume" :: waited 0.046s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:49:55 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7bdfc6-67bc-4aa9-a4d4-1927ff5bf66a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:49:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:56 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce Jul 08 10:49:56 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:57 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce" returned: 0 in 1.799s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:57 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce Jul 08 10:49:57 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:49:58 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 08 10:49:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b60d2e70-562f-4c71-8665-3c3997942bce" returned: 0 in 1.191s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:49:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "cinder-quobyte-b60d2e70-562f-4c71-8665-3c3997942bce" released by "delete_volume" :: held 3.115s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:49:59 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Created reservations ['4afdfddb-8e4d-4ab8-9fda-5b40c7695904', 'e65e1a3b-bd88-4602-9cdc-1cc53d284334', '0133bc2f-7b30-4cf3-96ee-20c2a2ede395', '7214cacb-3715-4032-984e-fee08744d7e1'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:49:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:49:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:49:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:49:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:49:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:49:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:49:59 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:49:59 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Flow 'volume_create_manager' (171be7eb-c708-4d79-ade4-7831670a9806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358f34d8-6e71-4e59-9646-3a5fe581abcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358f34d8-6e71-4e59-9646-3a5fe581abcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1511197383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89111805-c6ca-416b-ab2c-4ce82abf1bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e997373f7764076ae300279a80f1391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:00Z,use_quota=True,user_id='7f2aaf7bfbd84d52b28fe06e6c7698de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8254ca33-4cfd-4dc9-983d-5faa92a2dee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8254ca33-4cfd-4dc9-983d-5faa92a2dee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81fbd76-fd2a-44f2-8662-4c84efc6b24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81fbd76-fd2a-44f2-8662-4c84efc6b24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89111805-c6ca-416b-ab2c-4ce82abf1bf8', 'volume_name': 'volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790c624d-a3a1-4ffc-a241-799409b80502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790c624d-a3a1-4ffc-a241-799409b80502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22122c61-42b0-4664-b91a-cf11e00eab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:00 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Volume 89111805-c6ca-416b-ab2c-4ce82abf1bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8', 'volume_size': 1} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1511197383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89111805-c6ca-416b-ab2c-4ce82abf1bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e997373f7764076ae300279a80f1391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:00Z,use_quota=True,user_id='7f2aaf7bfbd84d52b28fe06e6c7698de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Creating volume 89111805-c6ca-416b-ab2c-4ce82abf1bf8 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:50:00 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:00 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:00 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8 1073741824 Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.608s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:00 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:50:00 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Deleted volume successfully. Jul 08 10:50:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1c072e3b-5eff-45c3-a9e6-ccd947b72c4d tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "cinder-b60d2e70-562f-4c71-8665-3c3997942bce-delete_volume" released by "delete_volume" :: held 5.202s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:50:02 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8 1073741824" returned: 0 in 1.903s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:02 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8 Jul 08 10:50:02 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:04 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8" returned: 0 in 2.106s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] <== create_volume: return (4141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:50:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.161s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22122c61-42b0-4664-b91a-cf11e00eab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b52ccfe-5e02-4752-a941-fbb6aa83e0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:05 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Volume volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8 (89111805-c6ca-416b-ab2c-4ce82abf1bf8): created successfully Jul 08 10:50:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b52ccfe-5e02-4752-a941-fbb6aa83e0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Flow 'volume_create_manager' (171be7eb-c708-4d79-ade4-7831670a9806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:50:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d00877e3-aca6-4c8d-95c6-dd873f723fe8 tempest-VolumeQuotasAdminTestJSON-1814305441 None] Created volume successfully. Jul 08 10:50:07 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0ea051b1-548d-4ac1-8ae9-a95cd926e360 tempest-VolumeQuotasAdminTestJSON-1561912864 None] Transfer volume completed successfully. Jul 08 10:50:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Acquiring lock "cinder-89111805-c6ca-416b-ab2c-4ce82abf1bf8-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:50:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Lock "cinder-89111805-c6ca-416b-ab2c-4ce82abf1bf8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:50:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Acquiring lock "cinder-quobyte-89111805-c6ca-416b-ab2c-4ce82abf1bf8" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:50:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Lock "cinder-quobyte-89111805-c6ca-416b-ab2c-4ce82abf1bf8" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:50:09 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b57253-10b3-475b-a8d8-b0de7ef1744b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:09 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8 Jul 08 10:50:09 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:10 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8" returned: 0 in 1.336s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:10 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8 Jul 08 10:50:10 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:11 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-89111805-c6ca-416b-ab2c-4ce82abf1bf8" returned: 0 in 1.360s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Lock "cinder-quobyte-89111805-c6ca-416b-ab2c-4ce82abf1bf8" released by "delete_volume" :: held 2.777s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:50:11 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Created reservations ['e9e9e472-4d10-482a-a65e-ba56ce212c58', '8f0dc2bc-63d9-466e-bad4-8338a39cbfda', 'a3adc73f-b28a-4f42-a6f4-8f131544b2b4', '4ed6ea82-2d08-4f5c-a591-58e625c40c20'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:50:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:50:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:50:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:12 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:50:12 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:12 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.866s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:12 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:50:12 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Deleted volume successfully. Jul 08 10:50:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a82a7e53-672e-4242-bb4c-aeac46650b9c tempest-VolumeQuotasAdminTestJSON-684131639 None] Lock "cinder-89111805-c6ca-416b-ab2c-4ce82abf1bf8-delete_volume" released by "delete_volume" :: held 4.018s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=54,cinder:SELECT=51,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=66,cinder:SELECT=41,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Flow 'volume_create_manager' (122a2316-385f-408f-957c-d5b3c315b5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b409b6-5bea-46c8-948b-c9514da519be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b409b6-5bea-46c8-948b-c9514da519be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1389011143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cd6653-57ff-4da6-a4a8-5d3fee641c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678a9c94ad5944bfac079e8499a4726f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:22Z,use_quota=True,user_id='2a4506f566d64fa292f2131b3eedf13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add0fe28-1009-46d2-90cd-c43e3758e5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add0fe28-1009-46d2-90cd-c43e3758e5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958423bd-7985-471e-b550-1583fb8b732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958423bd-7985-471e-b550-1583fb8b732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cd6653-57ff-4da6-a4a8-5d3fee641c09', 'volume_name': 'volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a663206-c060-40b6-9dbc-a9e864eb2cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a663206-c060-40b6-9dbc-a9e864eb2cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3edfe3-4135-4fb1-926d-64e4baba9abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:21 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Volume f6cd6653-57ff-4da6-a4a8-5d3fee641c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09', 'volume_size': 1} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1389011143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cd6653-57ff-4da6-a4a8-5d3fee641c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678a9c94ad5944bfac079e8499a4726f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:22Z,use_quota=True,user_id='2a4506f566d64fa292f2131b3eedf13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Creating volume f6cd6653-57ff-4da6-a4a8-5d3fee641c09 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:50:21 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:50:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:21 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 1073741824 Jul 08 10:50:21 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:22 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 1073741824" returned: 0 in 1.078s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:23 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 Jul 08 10:50:23 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:23 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09" returned: 0 in 0.768s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:50:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3edfe3-4135-4fb1-926d-64e4baba9abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec83e298-ea33-4194-b2df-243a651f2f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:23 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Volume volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 (f6cd6653-57ff-4da6-a4a8-5d3fee641c09): created successfully Jul 08 10:50:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec83e298-ea33-4194-b2df-243a651f2f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Flow 'volume_create_manager' (122a2316-385f-408f-957c-d5b3c315b5ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:50:23 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1f3bd234-8246-4b98-9b0b-7dfb7eeab59a tempest-AttachVolumeTestJSON-956411359 None] Created volume successfully. Jul 08 10:50:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-c17c056d-6842-4f98-a109-71599d26c4fa req-3fed7f72-5714-493a-b59c-2a4910e5ef58 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-c17c056d-6842-4f98-a109-71599d26c4fa req-3fed7f72-5714-493a-b59c-2a4910e5ef58 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:28 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[3052c3cc-52aa-48d5-a9d8-c78aa60bb80d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-c17c056d-6842-4f98-a109-71599d26c4fa req-3fed7f72-5714-493a-b59c-2a4910e5ef58 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:28 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 Jul 08 10:50:28 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:28 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-c17c056d-6842-4f98-a109-71599d26c4fa req-3fed7f72-5714-493a-b59c-2a4910e5ef58 tempest-AttachVolumeTestJSON-956411359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09" returned: 0 in 0.928s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-c17c056d-6842-4f98-a109-71599d26c4fa req-3fed7f72-5714-493a-b59c-2a4910e5ef58 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.947s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-c17c056d-6842-4f98-a109-71599d26c4fa req-3fed7f72-5714-493a-b59c-2a4910e5ef58 tempest-AttachVolumeTestJSON-956411359 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95c133fc-0a08-4971-b161-35b8c5927348', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:50:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-c17c056d-6842-4f98-a109-71599d26c4fa req-3fed7f72-5714-493a-b59c-2a4910e5ef58 tempest-AttachVolumeTestJSON-956411359 None] attachment_update completed successfully. Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Flow 'volume_create_manager' (a8c30925-e201-4d1d-883d-ccda83d64faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358c264f-2f00-44a8-b561-0640e1866c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358c264f-2f00-44a8-b561-0640e1866c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-669926050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a6ccf0-4ef0-4755-b6dc-95d7901582cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a606f51500764dc4b2c826f30e01d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:33Z,use_quota=True,user_id='c35b9a8b08c94effbd72586bf69b3d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35babc71-3d72-4803-ab8f-10bee78590bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35babc71-3d72-4803-ab8f-10bee78590bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed75610a-fb93-44dc-a172-9af1cf6352fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed75610a-fb93-44dc-a172-9af1cf6352fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a6ccf0-4ef0-4755-b6dc-95d7901582cf', 'volume_name': 'volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f567f252-3a3d-4e93-8466-998f9820ad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f567f252-3a3d-4e93-8466-998f9820ad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2a85d3-10b9-47ff-8bff-fb1047ee22fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:32 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Volume e9a6ccf0-4ef0-4755-b6dc-95d7901582cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf', 'volume_size': 1} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-669926050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a6ccf0-4ef0-4755-b6dc-95d7901582cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a606f51500764dc4b2c826f30e01d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:33Z,use_quota=True,user_id='c35b9a8b08c94effbd72586bf69b3d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Creating volume e9a6ccf0-4ef0-4755-b6dc-95d7901582cf {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:50:32 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:32 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf 1073741824 Jul 08 10:50:32 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-612e6d89-e04f-4f79-936d-405fcfde119b req-d6437d10-4661-4a44-9c3f-24ccc0a314fa tempest-TestStampPattern-920917405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:33 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf 1073741824" returned: 0 in 0.882s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:33 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf Jul 08 10:50:33 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:34 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf" returned: 0 in 0.653s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:50:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-612e6d89-e04f-4f79-936d-405fcfde119b req-d6437d10-4661-4a44-9c3f-24ccc0a314fa tempest-TestStampPattern-920917405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.308s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2a85d3-10b9-47ff-8bff-fb1047ee22fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2850e8-d981-4a56-a4c8-aaa76b1b8567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:34 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[9674fc79-d429-42d0-a531-9cddc6f35d40]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-612e6d89-e04f-4f79-936d-405fcfde119b req-d6437d10-4661-4a44-9c3f-24ccc0a314fa tempest-TestStampPattern-920917405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:34 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Volume volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf (e9a6ccf0-4ef0-4755-b6dc-95d7901582cf): created successfully Jul 08 10:50:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2850e8-d981-4a56-a4c8-aaa76b1b8567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Flow 'volume_create_manager' (a8c30925-e201-4d1d-883d-ccda83d64faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:50:34 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9a77e211-350c-4214-bc7a-22bf7ac162fa tempest-VolumesTransfersV357Test-1269211938 None] Created volume successfully. Jul 08 10:50:34 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 Jul 08 10:50:34 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Flow 'volume_create_manager' (4940d926-8d70-4088-88de-f298ec599114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad95f55-32f6-4edb-a9a7-322ca7acf3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad95f55-32f6-4edb-a9a7-322ca7acf3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1176913324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8daa72-972e-4401-970f-16d17c06e274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678a9c94ad5944bfac079e8499a4726f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:35Z,use_quota=True,user_id='2a4506f566d64fa292f2131b3eedf13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b023d6-57c0-4091-8a68-f4f4c2cd384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b023d6-57c0-4091-8a68-f4f4c2cd384e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:35 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01271bc6-6ae8-40e6-be83-85e3f38dde08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01271bc6-6ae8-40e6-be83-85e3f38dde08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d8daa72-972e-4401-970f-16d17c06e274', 'volume_name': 'volume-7d8daa72-972e-4401-970f-16d17c06e274', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9b9364-f0e7-4d18-98e6-316995317dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9b9364-f0e7-4d18-98e6-316995317dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d580c4-ef94-4155-949d-42bc37416fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:35 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Volume 7d8daa72-972e-4401-970f-16d17c06e274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d8daa72-972e-4401-970f-16d17c06e274', 'volume_size': 1} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-612e6d89-e04f-4f79-936d-405fcfde119b req-d6437d10-4661-4a44-9c3f-24ccc0a314fa tempest-TestStampPattern-920917405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757" returned: 0 in 0.925s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-612e6d89-e04f-4f79-936d-405fcfde119b req-d6437d10-4661-4a44-9c3f-24ccc0a314fa tempest-TestStampPattern-920917405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.953s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1176913324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8daa72-972e-4401-970f-16d17c06e274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678a9c94ad5944bfac079e8499a4726f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:35Z,use_quota=True,user_id='2a4506f566d64fa292f2131b3eedf13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Creating volume 7d8daa72-972e-4401-970f-16d17c06e274 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:50:35 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:35 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274 1073741824 Jul 08 10:50:35 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-612e6d89-e04f-4f79-936d-405fcfde119b req-d6437d10-4661-4a44-9c3f-24ccc0a314fa tempest-TestStampPattern-920917405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-543a6ee4-6bd5-4e26-8078-d227d360a757', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b01345d6-109b-4c67-a774-b6a7587922c1', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:50:35 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-612e6d89-e04f-4f79-936d-405fcfde119b req-d6437d10-4661-4a44-9c3f-24ccc0a314fa tempest-TestStampPattern-920917405 None] attachment_update completed successfully. Jul 08 10:50:35 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-259a9cb4-8aba-4496-97e8-4001ae50698d tempest-VolumesTransfersV357Test-718572452 None] Transfer volume completed successfully. Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-2a7ef657-1e85-440c-b7cb-380af46817de req-0e7b7892-27f1-43c4-a9a1-e2cc45707076 tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:36 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274 1073741824" returned: 0 in 0.980s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:36 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274 Jul 08 10:50:36 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Acquiring lock "cinder-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Lock "cinder-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:50:36 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Acquiring lock "cinder-quobyte-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274" returned: 0 in 0.706s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-2a7ef657-1e85-440c-b7cb-380af46817de req-0e7b7892-27f1-43c4-a9a1-e2cc45707076 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.865s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Lock "cinder-quobyte-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca49009-8daf-4b4a-9e4b-293e4a4a67f9]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-2a7ef657-1e85-440c-b7cb-380af46817de req-0e7b7892-27f1-43c4-a9a1-e2cc45707076 tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d580c4-ef94-4155-949d-42bc37416fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d8daa72-972e-4401-970f-16d17c06e274', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbe29f5-3c94-4014-9a35-19b7906bb4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4820213-2f60-434b-a15b-f9789596f366]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:36 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Volume volume-7d8daa72-972e-4401-970f-16d17c06e274 (7d8daa72-972e-4401-970f-16d17c06e274): created successfully Jul 08 10:50:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbe29f5-3c94-4014-9a35-19b7906bb4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Flow 'volume_create_manager' (4940d926-8d70-4088-88de-f298ec599114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:50:37 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-37686dca-de91-476e-a3af-fe639d01cd62 tempest-AttachVolumeTestJSON-956411359 None] Created volume successfully. Jul 08 10:50:37 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 Jul 08 10:50:37 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:37 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf Jul 08 10:50:37 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:37 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-2a7ef657-1e85-440c-b7cb-380af46817de req-0e7b7892-27f1-43c4-a9a1-e2cc45707076 tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94" returned: 0 in 0.829s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-2a7ef657-1e85-440c-b7cb-380af46817de req-0e7b7892-27f1-43c4-a9a1-e2cc45707076 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.860s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-2a7ef657-1e85-440c-b7cb-380af46817de req-0e7b7892-27f1-43c4-a9a1-e2cc45707076 tempest-TestServerVolumeAttachmentScenario-247934715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-e1826b60-8d8f-4adb-af83-05cac3be2f94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9174ffae-0e9a-4661-acec-444a1b7316ca', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:50:37 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf" returned: 0 in 0.907s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:37 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-2a7ef657-1e85-440c-b7cb-380af46817de req-0e7b7892-27f1-43c4-a9a1-e2cc45707076 tempest-TestServerVolumeAttachmentScenario-247934715 None] attachment_update completed successfully. Jul 08 10:50:37 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf Jul 08 10:50:37 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:38 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf" returned: 0 in 0.652s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Lock "cinder-quobyte-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf" released by "delete_volume" :: held 1.615s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:50:38 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Created reservations ['b826ab2d-e9c9-4bd0-adf9-94b9b520e224', '9f60c93a-6a13-4250-b0ec-7d11cc62c375', '4e73e01a-6dad-4b95-a60a-f91b96da3b39', '7943d71a-e410-4547-ba25-60345454689b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:50:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:50:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:50:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:38 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:50:38 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:39 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.771s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:50:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Deleted volume successfully. Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10d4e683-91c8-4c9d-8ab8-d416be41755f tempest-VolumesTransfersV357Test-1310658821 None] Lock "cinder-e9a6ccf0-4ef0-4755-b6dc-95d7901582cf-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Flow 'volume_create_manager' (c94f7de8-8d6d-435e-890e-6e1c08a71d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1539b636-2e54-4891-aa78-c83372be6c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1539b636-2e54-4891-aa78-c83372be6c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-381670191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f672e0ce-21ef-4e6b-9d66-2c26aadd652e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a606f51500764dc4b2c826f30e01d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:40Z,use_quota=True,user_id='c35b9a8b08c94effbd72586bf69b3d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b856e02-dd3e-4cde-80cc-121eb9fa7cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b856e02-dd3e-4cde-80cc-121eb9fa7cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b40a7e3-a8f6-49ab-ae35-2c244c11520a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b40a7e3-a8f6-49ab-ae35-2c244c11520a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f672e0ce-21ef-4e6b-9d66-2c26aadd652e', 'volume_name': 'volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f73b5d5-badd-4c99-9aac-0c1757a72300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f73b5d5-badd-4c99-9aac-0c1757a72300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d5e998-9e6b-4e46-808f-ebc78887086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:39 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Volume f672e0ce-21ef-4e6b-9d66-2c26aadd652e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e', 'volume_size': 1} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-381670191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f672e0ce-21ef-4e6b-9d66-2c26aadd652e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a606f51500764dc4b2c826f30e01d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:40Z,use_quota=True,user_id='c35b9a8b08c94effbd72586bf69b3d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Creating volume f672e0ce-21ef-4e6b-9d66-2c26aadd652e {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:50:39 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:50:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:39 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e 1073741824 Jul 08 10:50:39 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:40 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e 1073741824" returned: 0 in 0.928s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:40 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e Jul 08 10:50:40 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-882295b8-51ca-4c54-99e1-c03eb0a99d62 req-a8fa33c6-fe7f-4588-b674-0b8650d710f3 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:41 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e" returned: 0 in 0.739s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:50:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-882295b8-51ca-4c54-99e1-c03eb0a99d62 req-a8fa33c6-fe7f-4588-b674-0b8650d710f3 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.618s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d5e998-9e6b-4e46-808f-ebc78887086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ab54ba-31e5-4229-a46b-1156a37ff669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:41 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc47823f-d227-42bf-97ae-f3b40eb73938]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-882295b8-51ca-4c54-99e1-c03eb0a99d62 req-a8fa33c6-fe7f-4588-b674-0b8650d710f3 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:41 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Volume volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e (f672e0ce-21ef-4e6b-9d66-2c26aadd652e): created successfully Jul 08 10:50:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ab54ba-31e5-4229-a46b-1156a37ff669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Flow 'volume_create_manager' (c94f7de8-8d6d-435e-890e-6e1c08a71d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:50:41 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2c76fef0-fc21-4c74-9a32-b63d33ec743b tempest-VolumesTransfersV357Test-1269211938 None] Created volume successfully. Jul 08 10:50:41 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274 Jul 08 10:50:41 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Acquiring lock "cinder-f672e0ce-21ef-4e6b-9d66-2c26aadd652e-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:50:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Lock "cinder-f672e0ce-21ef-4e6b-9d66-2c26aadd652e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:50:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Acquiring lock "cinder-quobyte-f672e0ce-21ef-4e6b-9d66-2c26aadd652e" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:50:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Lock "cinder-quobyte-f672e0ce-21ef-4e6b-9d66-2c26aadd652e" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:50:42 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd58bd02-8bcd-4abf-b3b7-663766c32b5d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:42 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e Jul 08 10:50:42 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:42 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-882295b8-51ca-4c54-99e1-c03eb0a99d62 req-a8fa33c6-fe7f-4588-b674-0b8650d710f3 tempest-AttachVolumeTestJSON-956411359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274" returned: 0 in 0.986s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-882295b8-51ca-4c54-99e1-c03eb0a99d62 req-a8fa33c6-fe7f-4588-b674-0b8650d710f3 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.020s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-882295b8-51ca-4c54-99e1-c03eb0a99d62 req-a8fa33c6-fe7f-4588-b674-0b8650d710f3 tempest-AttachVolumeTestJSON-956411359 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-7d8daa72-972e-4401-970f-16d17c06e274', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd973c303-6ef2-42d6-978a-ca0a66ac17c2', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:50:42 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-882295b8-51ca-4c54-99e1-c03eb0a99d62 req-a8fa33c6-fe7f-4588-b674-0b8650d710f3 tempest-AttachVolumeTestJSON-956411359 None] attachment_update completed successfully. Jul 08 10:50:43 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e" returned: 0 in 0.858s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:43 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e Jul 08 10:50:43 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:43 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f672e0ce-21ef-4e6b-9d66-2c26aadd652e" returned: 0 in 0.770s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Lock "cinder-quobyte-f672e0ce-21ef-4e6b-9d66-2c26aadd652e" released by "delete_volume" :: held 1.701s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:50:43 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Created reservations ['90b16898-ccc7-46b0-b521-69715857153c', '667cd101-80c1-4bd7-b905-b501c78665df', '97fcf8d4-d55a-4dd8-90e7-157df2286e75', 'bf5148c1-6e00-4491-bdff-6c040e7229cb'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:50:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:50:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:50:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:44 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:50:44 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:44 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-4497ee77-e8d3-46f9-b8ae-b60f10806dc7 req-1533e511-ab26-44bf-976c-3650478d3162 tempest-TestStampPattern-920917405 None] Terminate volume connection completed successfully. Jul 08 10:50:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-4497ee77-e8d3-46f9-b8ae-b60f10806dc7 req-1533e511-ab26-44bf-976c-3650478d3162 tempest-TestStampPattern-920917405 None] Deleting attachment b01345d6-109b-4c67-a774-b6a7587922c1. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:50:44 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.767s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:44 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:50:44 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Deleted volume successfully. Jul 08 10:50:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52b97c2b-5a1e-4fa7-85c1-a2fa8daaaa0a tempest-VolumesTransfersV357Test-1310658821 None] Lock "cinder-f672e0ce-21ef-4e6b-9d66-2c26aadd652e-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:50:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] Creating offline snapshot d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c of volume 543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:50:46 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0055bb-867b-4f38-b911-8ebd84e01897]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:46 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 Jul 08 10:50:46 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:47 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757" returned: 0 in 0.919s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:47 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c 1G Jul 08 10:50:47 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-4bf9f9e5-1f84-4100-8dc4-ce18df8ba958 req-9311ca47-4c2e-40ca-9467-c415b82fbdf9 tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:48 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c 1G" returned: 0 in 0.928s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-543a6ee4-6bd5-4e26-8078-d227d360a757 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:48 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-543a6ee4-6bd5-4e26-8078-d227d360a757 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c Jul 08 10:50:48 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:49 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-7b0cfdf1-3f6d-4947-a437-b7f4e6c64156 req-61a44547-2f86-428d-9b43-871703fe587d tempest-AttachVolumeTestJSON-956411359 None] Terminate volume connection completed successfully. Jul 08 10:50:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-7b0cfdf1-3f6d-4947-a437-b7f4e6c64156 req-61a44547-2f86-428d-9b43-871703fe587d tempest-AttachVolumeTestJSON-956411359 None] Deleting attachment 95c133fc-0a08-4971-b161-35b8c5927348. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:50:49 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-543a6ee4-6bd5-4e26-8078-d227d360a757 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c" returned: 0 in 0.856s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:49 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c is being set with open permissions: ugo+rw Jul 08 10:50:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:49 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c Jul 08 10:50:49 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:50 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c" returned: 0 in 0.688s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:50 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.info Jul 08 10:50:50 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:50 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:50:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Flow 'volume_create_manager' (9993ab83-60ea-4acd-b5fb-f2bff991caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:50:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5782d38a-a527-4783-861b-950bc0c3f515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5782d38a-a527-4783-861b-950bc0c3f515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-838015947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b07f525-a318-4ba8-96eb-3bf4046e3372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b995701f5944e7b8396da43f62b48fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:51Z,use_quota=True,user_id='f4de3b1c30a7458b84ce6e465a1cff91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4686c6-8474-4be5-9ce1-ceb2a849e2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4686c6-8474-4be5-9ce1-ceb2a849e2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a10c40-e5aa-48a5-870c-a092b253aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:50 devstack cinder-volume[86913]: DEBUG cinder.image.glance [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Creating Keystone auth plugin from conf {{(pid=86913) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 10:50:50 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.info" returned: 0 in 0.738s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:51 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.info is being set with open permissions: ugo+rw Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:51 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.info Jul 08 10:50:51 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a10c40-e5aa-48a5-870c-a092b253aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b07f525-a318-4ba8-96eb-3bf4046e3372', 'volume_name': 'volume-8b07f525-a318-4ba8-96eb-3bf4046e3372', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508c4a7b-23fd-4960-861c-9aa0ff23df6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508c4a7b-23fd-4960-861c-9aa0ff23df6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cb6b6c-cad4-4ce6-8211-c54a72ed038c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:50:51 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Volume 8b07f525-a318-4ba8-96eb-3bf4046e3372: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b07f525-a318-4ba8-96eb-3bf4046e3372', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Trying to clone 8b07f525-a318-4ba8-96eb-3bf4046e3372 from image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]). {{(pid=86913) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 10:50:51 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Image download 20.69 MB at 20.69 MB/s Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8723310-ed62-4c8e-88d1-86326773d6e2]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:51 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD Jul 08 10:50:51 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:51 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.info" returned: 0 in 0.685s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.917s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-4bf9f9e5-1f84-4100-8dc4-ce18df8ba958 req-9311ca47-4c2e-40ca-9467-c415b82fbdf9 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.431s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a0703-3d20-45bc-ba91-4ff5ebe1d7a0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-4bf9f9e5-1f84-4100-8dc4-ce18df8ba958 req-9311ca47-4c2e-40ca-9467-c415b82fbdf9 tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:51 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-46b1a09e-ae27-4586-a9e3-139bcf174d41 tempest-TestStampPattern-920917405 None] Create snapshot completed successfully Jul 08 10:50:51 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 Jul 08 10:50:51 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:52 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:52 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Temporary image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c is fetched for user f4de3b1c30a7458b84ce6e465a1cff91. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 10:50:52 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-40434f1f-26ff-4a9c-8ff4-0f125c951ee1 req-0c2878bd-e2dc-4730-bdb4-b215e25316ce tempest-AttachVolumeTestJSON-956411359 None] Terminate volume connection completed successfully. Jul 08 10:50:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-40434f1f-26ff-4a9c-8ff4-0f125c951ee1 req-0c2878bd-e2dc-4730-bdb4-b215e25316ce tempest-AttachVolumeTestJSON-956411359 None] Deleting attachment d973c303-6ef2-42d6-978a-ca0a66ac17c2. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:50:52 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b568c844-e812-46c5-ac10-8f9274a61ab9]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:52 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD Jul 08 10:50:52 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:52 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-4bf9f9e5-1f84-4100-8dc4-ce18df8ba958 req-9311ca47-4c2e-40ca-9467-c415b82fbdf9 tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3" returned: 0 in 0.858s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-4bf9f9e5-1f84-4100-8dc4-ce18df8ba958 req-9311ca47-4c2e-40ca-9467-c415b82fbdf9 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.886s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-4bf9f9e5-1f84-4100-8dc4-ce18df8ba958 req-9311ca47-4c2e-40ca-9467-c415b82fbdf9 tempest-TestServerVolumeAttachmentScenario-247934715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-f7d821fe-bc0d-45ce-877b-73278d88acb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '932dd7e8-0148-4ced-85a0-f0b7233befb9', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:50:52 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-4bf9f9e5-1f84-4100-8dc4-ce18df8ba958 req-9311ca47-4c2e-40ca-9467-c415b82fbdf9 tempest-TestServerVolumeAttachmentScenario-247934715 None] attachment_update completed successfully. Jul 08 10:50:53 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD" returned: 0 in 0.841s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-838015947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b07f525-a318-4ba8-96eb-3bf4046e3372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b995701f5944e7b8396da43f62b48fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:50:51Z,use_quota=True,user_id='f4de3b1c30a7458b84ce6e465a1cff91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Creating volume 8b07f525-a318-4ba8-96eb-3bf4046e3372 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:50:53 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:53 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 1073741824 Jul 08 10:50:53 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:53 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:50:53 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:54 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 1073741824" returned: 0 in 1.013s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:54 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 Jul 08 10:50:54 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:54 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.803s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:50:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:50:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:50:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:50:55 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372" returned: 0 in 0.750s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:50:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:50:55 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Attempting download of 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c ((None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}])) to volume 8b07f525-a318-4ba8-96eb-3bf4046e3372. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 10:50:55 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[284dd8fa-fea0-4440-8864-8ec214ce5dfc]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_fecffqfi {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:55 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_fecffqfi Jul 08 10:50:55 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:56 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_fecffqfi" returned: 0 in 0.839s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_fecffqfi {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:56 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_fecffqfi Jul 08 10:50:56 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:56 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_fecffqfi" returned: 1 in 0.887s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_fecffqfi' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:50:56 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27fd0c5-9033-44e4-b3f7-5c3aa1c57f3b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:50:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:57 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD Jul 08 10:50:57 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:57 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 08 10:50:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD" returned: 0 in 1.018s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:50:57 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c was qcow2, converting to raw {{(pid=86913) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 10:50:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:50:57 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 Jul 08 10:50:57 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:50:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-2ea0436c-e4d3-4b31-9afe-dbf096a5939a req-ff639325-1ccf-4d8f-8a01-731ab63a41ed tempest-TestServerVolumeAttachmentScenario-247934715 None] Terminate volume connection completed successfully. Jul 08 10:50:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-2ea0436c-e4d3-4b31-9afe-dbf096a5939a req-ff639325-1ccf-4d8f-8a01-731ab63a41ed tempest-TestServerVolumeAttachmentScenario-247934715 None] Deleting attachment 932dd7e8-0148-4ced-85a0-f0b7233befb9. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:51:00 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372" returned: 0 in 2.541s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:00 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_jspbya5edevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:51:00 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Converted 112.00 MB image at 44.06 MB/s Jul 08 10:51:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:00 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 1G Jul 08 10:51:00 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:01 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 1G" returned: 0 in 0.809s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:01 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a3abac-1bb5-46a5-866a-9d6fd5d46e1f]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:01 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 Jul 08 10:51:01 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:02 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372" returned: 0 in 0.890s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:02 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 Jul 08 10:51:02 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:03 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372" returned: 1 in 1.050s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Downloaded image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c ((None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}])) to volume 8b07f525-a318-4ba8-96eb-3bf4046e3372 successfully. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Temporary image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c for user f4de3b1c30a7458b84ce6e465a1cff91 is deleted. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Marking volume 8b07f525-a318-4ba8-96eb-3bf4046e3372 as bootable. {{(pid=86913) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 10:51:03 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-1fb9e8b3-86d5-4b1d-85eb-b2b3a1d3d21a req-f7b7362a-45ba-4957-90c3-4e161aeb2aaf tempest-TestServerVolumeAttachmentScenario-247934715 None] Terminate volume connection completed successfully. Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-1fb9e8b3-86d5-4b1d-85eb-b2b3a1d3d21a req-f7b7362a-45ba-4957-90c3-4e161aeb2aaf tempest-TestServerVolumeAttachmentScenario-247934715 None] Deleting attachment 9174ffae-0e9a-4661-acec-444a1b7316ca. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Copying metadata from image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c to 8b07f525-a318-4ba8-96eb-3bf4046e3372. {{(pid=86913) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Creating volume glance metadata for volume 8b07f525-a318-4ba8-96eb-3bf4046e3372 backed by image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86913) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Flow 'volume_create_manager' (6ad9d2f5-2e03-428e-898d-f8eccad500bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28c6883-1c8c-4df4-aca4-8b467b43a81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28c6883-1c8c-4df4-aca4-8b467b43a81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1058258704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a5febd-9c9b-46e2-ae66-162350d3fb32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a830df29b16c4f8a995e14932f2b51ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:03Z,use_quota=True,user_id='a68d7cab464f4335a50483c7e646a5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feac8fb5-c887-417e-bcc7-01bad01a6818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feac8fb5-c887-417e-bcc7-01bad01a6818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb877e8-93f7-453c-a261-f0ab0eba8ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb877e8-93f7-453c-a261-f0ab0eba8ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3a5febd-9c9b-46e2-ae66-162350d3fb32', 'volume_name': 'volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32', 'volume_size': 1, 'snapshot_id': 'd2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81816b63-c699-403e-8b6e-ce29e353eef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81816b63-c699-403e-8b6e-ce29e353eef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ec4ae2-4cc0-49a7-b13f-556f7bc59180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:03 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Volume d3a5febd-9c9b-46e2-ae66-162350d3fb32: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32', 'volume_size': 1, 'snapshot_id': 'd2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c'} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cb6b6c-cad4-4ce6-8211-c54a72ed038c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b07f525-a318-4ba8-96eb-3bf4046e3372', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b26f97-7cc8-4114-b2b4-25a9a0ad994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Acquiring lock "cinder-quobyte-d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c-d3a5febd-9c9b-46e2-ae66-162350d3fb32" by "_create_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:03 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Volume volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 (8b07f525-a318-4ba8-96eb-3bf4046e3372): created successfully Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b26f97-7cc8-4114-b2b4-25a9a0ad994e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Flow 'volume_create_manager' (9993ab83-60ea-4acd-b5fb-f2bff991caa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c-d3a5febd-9c9b-46e2-ae66-162350d3fb32" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Creating volume d3a5febd-9c9b-46e2-ae66-162350d3fb32 from snapshot d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c {{(pid=86913) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Acquiring lock "cinder-quobyte-d3a5febd-9c9b-46e2-ae66-162350d3fb32" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:03 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4f173933-f8f1-40cb-9b0e-f8cf752efece tempest-VolumesExtendTest-2006146690 None] Created volume successfully. Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-d3a5febd-9c9b-46e2-ae66-162350d3fb32" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] snapshot: d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c, volume: d3a5febd-9c9b-46e2-ae66-162350d3fb32, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[058be28c-d658-4af1-a7d8-fa51ad5e7aa1]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:03 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c Jul 08 10:51:03 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c9f7f293-a74b-453a-9e6f-6cbf7cb41198 tempest-VolumesExtendTest-2006146690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "cinder-7d8daa72-972e-4401-970f-16d17c06e274-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-7d8daa72-972e-4401-970f-16d17c06e274-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "cinder-quobyte-7d8daa72-972e-4401-970f-16d17c06e274" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-quobyte-7d8daa72-972e-4401-970f-16d17c06e274" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca871a2e-1576-48f4-9a08-99d82d01a32d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:04 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274 Jul 08 10:51:04 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:04 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c" returned: 0 in 0.967s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-543a6ee4-6bd5-4e26-8078-d227d360a757(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2eb8371-abad-4d06-a168-aa93e029cf8c]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:04 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 Jul 08 10:51:04 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:05 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274" returned: 0 in 0.849s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:05 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274 Jul 08 10:51:05 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:05 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757" returned: 0 in 0.955s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:05 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 10:51:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:05 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 Jul 08 10:51:05 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:05 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7d8daa72-972e-4401-970f-16d17c06e274" returned: 0 in 0.777s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-quobyte-7d8daa72-972e-4401-970f-16d17c06e274" released by "delete_volume" :: held 1.683s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:05 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Created reservations ['564ced1c-4279-4483-901f-4119bd9f8dd0', 'd33b22c3-df72-43ef-b579-d567094e578a', '4b8c506c-c559-4340-b7f9-b9fce959f463', '0003da0a-e4a4-412e-b802-f1ccdf13fa87'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:06 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:51:06 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "cinder-f6cd6653-57ff-4da6-a4a8-5d3fee641c09-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-f6cd6653-57ff-4da6-a4a8-5d3fee641c09-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "cinder-quobyte-f6cd6653-57ff-4da6-a4a8-5d3fee641c09" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-quobyte-f6cd6653-57ff-4da6-a4a8-5d3fee641c09" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1d7201-4dc8-4faa-a6f7-0d261933ff41]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:06 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 Jul 08 10:51:06 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:07 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.010s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:07 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:51:07 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Deleted volume successfully. Jul 08 10:51:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ea1ea93b-3878-4816-a7fb-921c3ded0090 tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-7d8daa72-972e-4401-970f-16d17c06e274-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:08 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09" returned: 0 in 1.662s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:08 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09 Jul 08 10:51:08 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:10 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6cd6653-57ff-4da6-a4a8-5d3fee641c09" returned: 0 in 2.285s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-quobyte-f6cd6653-57ff-4da6-a4a8-5d3fee641c09" released by "delete_volume" :: held 4.026s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:10 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Created reservations ['c33c1acc-4a26-4d69-a3cb-a0633a299cd6', '86402ce3-de0f-4692-b45e-945431071dd5', '70e04ab0-5a8a-4aac-8c8b-e96659a0446b', 'b5fcede8-de46-4bab-bc8e-698cb70a2113'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:51:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:11 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:51:11 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "cinder-cbd29a92-6e1d-4ede-a49a-22c880730d0f-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-cbd29a92-6e1d-4ede-a49a-22c880730d0f-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "cinder-quobyte-cbd29a92-6e1d-4ede-a49a-22c880730d0f" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-quobyte-cbd29a92-6e1d-4ede-a49a-22c880730d0f" acquired by "delete_volume" :: waited 0.032s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:12 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[687dd629-17ce-4eab-8f37-7976fab8c447]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:12 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f Jul 08 10:51:12 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:12 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.592s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:12 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:51:12 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Deleted volume successfully. Jul 08 10:51:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8cf0d940-d517-4707-9a2d-0e8254530710 tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-f6cd6653-57ff-4da6-a4a8-5d3fee641c09-delete_volume" released by "delete_volume" :: held 6.516s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:13 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32" returned: 0 in 7.765s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:13 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9f0851-02e6-4e50-8a1f-bc028f562363]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:13 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 Jul 08 10:51:13 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:14 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f" returned: 0 in 1.799s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:14 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f Jul 08 10:51:14 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:14 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757" returned: 0 in 1.280s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:14 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757, size 1024.00 MB, duration 7.77 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:51:14 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Converted 1024.00 MB image at 131.86 MB/s Jul 08 10:51:14 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 is being set with open permissions: ugo+rw Jul 08 10:51:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:14 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 Jul 08 10:51:14 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:15 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cbd29a92-6e1d-4ede-a49a-22c880730d0f" returned: 0 in 0.911s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-quobyte-cbd29a92-6e1d-4ede-a49a-22c880730d0f" released by "delete_volume" :: held 2.854s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Created reservations ['c8710c51-b277-4afe-ae30-0a2f87af441e', '4fba20c2-eb67-4c72-9d02-926de5151c5b', '9f7fa5b8-9b0c-44c8-a5b8-0cfb0dfa6efd', 'c4cf0cc9-273f-4040-911f-12b0b55a2e5f'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:15 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:51:15 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:15 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32" returned: 0 in 0.970s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-d3a5febd-9c9b-46e2-ae66-162350d3fb32" released by "_copy_volume_from_snapshot" :: held 12.089s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c-d3a5febd-9c9b-46e2-ae66-162350d3fb32" released by "_create_volume_from_snapshot" :: held 12.130s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.165s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c9f7f293-a74b-453a-9e6f-6cbf7cb41198 tempest-VolumesExtendTest-2006146690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 11.671s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ec4ae2-4cc0-49a7-b13f-556f7bc59180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32', 'volume_size': 1, 'snapshot_id': 'd2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de803743-bb28-4a4b-886c-f60c72bb5c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49cc6a8-5ab1-433a-af6d-0b86356f2a3e]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9f7f293-a74b-453a-9e6f-6cbf7cb41198 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:15 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Volume volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 (d3a5febd-9c9b-46e2-ae66-162350d3fb32): created successfully Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de803743-bb28-4a4b-886c-f60c72bb5c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:15 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Flow 'volume_create_manager' (6ad9d2f5-2e03-428e-898d-f8eccad500bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:15 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-23ff3904-85cd-439b-8cc9-cf3be980997a tempest-TestStampPattern-920917405 None] Created volume successfully. Jul 08 10:51:16 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 Jul 08 10:51:16 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:16 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.854s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:16 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:51:16 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Deleted volume successfully. Jul 08 10:51:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-95a968cb-d5e7-4775-b3cc-2e29a4c5b12e tempest-AttachVolumeTestJSON-956411359 None] Lock "cinder-cbd29a92-6e1d-4ede-a49a-22c880730d0f-delete_volume" released by "delete_volume" :: held 4.190s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:16 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9f7f293-a74b-453a-9e6f-6cbf7cb41198 tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372" returned: 0 in 1.038s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9f7f293-a74b-453a-9e6f-6cbf7cb41198 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:16 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 Jul 08 10:51:16 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:17 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9f7f293-a74b-453a-9e6f-6cbf7cb41198 tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372" returned: 1 in 0.853s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9f7f293-a74b-453a-9e6f-6cbf7cb41198 tempest-VolumesExtendTest-2006146690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:51:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9f7f293-a74b-453a-9e6f-6cbf7cb41198 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 2G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "cinder-f7d821fe-bc0d-45ce-877b-73278d88acb3-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "cinder-f7d821fe-bc0d-45ce-877b-73278d88acb3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9f7f293-a74b-453a-9e6f-6cbf7cb41198 tempest-VolumesExtendTest-2006146690 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 2G" returned: 0 in 0.138s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c9f7f293-a74b-453a-9e6f-6cbf7cb41198 tempest-VolumesExtendTest-2006146690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.125s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "cinder-quobyte-f7d821fe-bc0d-45ce-877b-73278d88acb3" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "cinder-quobyte-f7d821fe-bc0d-45ce-877b-73278d88acb3" acquired by "delete_volume" :: waited 0.058s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:17 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d27937-08ec-4824-887d-fd8c2478ba19]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c9f7f293-a74b-453a-9e6f-6cbf7cb41198 tempest-VolumesExtendTest-2006146690 None] Extend volume completed successfully. Jul 08 10:51:18 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 Jul 08 10:51:18 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:18 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3" returned: 0 in 0.976s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:18 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3 Jul 08 10:51:18 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Acquiring lock "cinder-8b07f525-a318-4ba8-96eb-3bf4046e3372-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Lock "cinder-8b07f525-a318-4ba8-96eb-3bf4046e3372-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Acquiring lock "cinder-quobyte-8b07f525-a318-4ba8-96eb-3bf4046e3372" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Lock "cinder-quobyte-8b07f525-a318-4ba8-96eb-3bf4046e3372" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:19 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[92630ead-e5aa-41dc-8865-b28dc9a217b3]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:19 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 Jul 08 10:51:19 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:20 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7d821fe-bc0d-45ce-877b-73278d88acb3" returned: 0 in 1.598s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "cinder-quobyte-f7d821fe-bc0d-45ce-877b-73278d88acb3" released by "delete_volume" :: held 2.662s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:20 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Created reservations ['8050bbac-c85e-4073-8df1-257ca602780e', '91b185d3-f24c-45ec-9d53-9c4e5a104056', '68c7f363-8c43-4295-a856-15a8627d50ea', '2e70b39f-11b4-4c79-be7e-1369415b960f'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:51:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:20 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:51:20 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "cinder-e1826b60-8d8f-4adb-af83-05cac3be2f94-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "cinder-e1826b60-8d8f-4adb-af83-05cac3be2f94-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:21 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372" returned: 0 in 1.784s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "cinder-quobyte-e1826b60-8d8f-4adb-af83-05cac3be2f94" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "cinder-quobyte-e1826b60-8d8f-4adb-af83-05cac3be2f94" acquired by "delete_volume" :: waited 0.039s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:21 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 Jul 08 10:51:21 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:21 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6758af-41f9-46ed-945e-876308889e81]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:22 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 Jul 08 10:51:22 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:22 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.370s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:22 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:51:22 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Deleted volume successfully. Jul 08 10:51:22 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=91,cinder:UPDATE=79,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:51:22 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-64fcd07f-d6e9-4314-9c48-c967f84f34fe tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "cinder-f7d821fe-bc0d-45ce-877b-73278d88acb3-delete_volume" released by "delete_volume" :: held 4.483s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:22 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372" returned: 1 in 1.340s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:51:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:22 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372 Jul 08 10:51:22 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:24 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94" returned: 0 in 2.587s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:24 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94 Jul 08 10:51:24 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:24 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8b07f525-a318-4ba8-96eb-3bf4046e3372" returned: 0 in 1.595s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Lock "cinder-quobyte-8b07f525-a318-4ba8-96eb-3bf4046e3372" released by "delete_volume" :: held 4.852s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=89,cinder:UPDATE=78,cinder:DELETE=6,cinder:INSERT=22 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Created reservations ['1d83b89b-b5ce-4198-90c8-e5283d908ae2', 'bafb0e05-013e-4e6c-87ef-b01b8145c2ab', 'ef763caa-691a-46a0-9882-1c699997ffa7', '6384a36f-0c18-4f97-9c8f-68771134a93d'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:24 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:51:24 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:25 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e1826b60-8d8f-4adb-af83-05cac3be2f94" returned: 0 in 1.068s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "cinder-quobyte-e1826b60-8d8f-4adb-af83-05cac3be2f94" released by "delete_volume" :: held 3.766s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:25 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Created reservations ['d08ac580-0131-480d-86ba-6ab7aa58c04a', 'e3d9d487-806b-484f-b4ed-5ac18bc903eb', '98b95be0-d65a-417e-ac12-b270b5bb9d0f', '8d071872-f2c9-4016-b17a-e2dd266f8804'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:51:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:25 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:51:25 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:26 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.677s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:51:26 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Deleted volume successfully. Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-98d5d411-ad46-49af-8ac2-0ad99e757b54 tempest-VolumesExtendTest-2006146690 None] Lock "cinder-8b07f525-a318-4ba8-96eb-3bf4046e3372-delete_volume" released by "delete_volume" :: held 7.113s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Flow 'volume_create_manager' (d3d3e1f8-e61b-42b8-a3f9-548d09594681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bc09ad-8193-4cf6-86fe-2f8d0cbcf328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bc09ad-8193-4cf6-86fe-2f8d0cbcf328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-673677230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c43a84-51a4-4480-a4d3-bb8976fc6ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b995701f5944e7b8396da43f62b48fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:27Z,use_quota=True,user_id='f4de3b1c30a7458b84ce6e465a1cff91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ee7c1e-f5fe-4a91-b90d-22d590a8dfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ee7c1e-f5fe-4a91-b90d-22d590a8dfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e49bd33-1018-469a-bfd2-ff531a8d743a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e49bd33-1018-469a-bfd2-ff531a8d743a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9c43a84-51a4-4480-a4d3-bb8976fc6ec5', 'volume_name': 'volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a42f10-49f3-44c7-91a5-d2596b42258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a42f10-49f3-44c7-91a5-d2596b42258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd49bda-573b-4251-a6a9-9e3e65f92614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:27 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Volume c9c43a84-51a4-4480-a4d3-bb8976fc6ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5', 'volume_size': 1} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-673677230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c43a84-51a4-4480-a4d3-bb8976fc6ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b995701f5944e7b8396da43f62b48fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:27Z,use_quota=True,user_id='f4de3b1c30a7458b84ce6e465a1cff91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Creating volume c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:51:27 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:27 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.429s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:51:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Deleted volume successfully. Jul 08 10:51:27 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 1073741824 Jul 08 10:51:27 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4cb7a4f7-9f7c-4ea2-aba5-7c9dd3733078 tempest-TestServerVolumeAttachmentScenario-247934715 None] Lock "cinder-e1826b60-8d8f-4adb-af83-05cac3be2f94-delete_volume" released by "delete_volume" :: held 5.795s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:28 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 1073741824" returned: 0 in 1.525s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:28 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 Jul 08 10:51:28 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:29 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" returned: 0 in 0.979s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] <== create_volume: return (2607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:51:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.615s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd49bda-573b-4251-a6a9-9e3e65f92614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d8b8d9-7386-4b74-9c13-7d8f44e1bbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:29 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Volume volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 (c9c43a84-51a4-4480-a4d3-bb8976fc6ec5): created successfully Jul 08 10:51:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d8b8d9-7386-4b74-9c13-7d8f44e1bbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Flow 'volume_create_manager' (d3d3e1f8-e61b-42b8-a3f9-548d09594681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b367a835-e3bb-49ae-a318-e587ddff198c tempest-VolumesExtendTest-2006146690 None] Created volume successfully. Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] Creating offline snapshot e2611bc4-f853-4697-95a6-ce14469fc879 of volume c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Flow 'volume_create_manager' (ba58a036-f9b9-4d1d-a507-174645ffca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66e1cb7-feb7-4ebd-81b1-28b3e358a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a139076-f433-4eef-80fc-7c5acbe810f9]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66e1cb7-feb7-4ebd-81b1-28b3e358a982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2050769919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7924dd-15b3-4022-858a-8315ee93f599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3ef4a8f1bf4f918baf68ba29968629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:30Z,use_quota=True,user_id='ec9e0824b4c84d94b32f0a02f43188f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c5b7db-e907-420c-8eda-3216c2e41cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c5b7db-e907-420c-8eda-3216c2e41cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81358048-8f76-486f-a07f-14aae4136aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81358048-8f76-486f-a07f-14aae4136aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f7924dd-15b3-4022-858a-8315ee93f599', 'volume_name': 'volume-4f7924dd-15b3-4022-858a-8315ee93f599', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb7ff06-3d26-4b44-acf7-571111789235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb7ff06-3d26-4b44-acf7-571111789235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9be97b0-1164-402e-940b-0d1f12bcbf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:30 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Volume 4f7924dd-15b3-4022-858a-8315ee93f599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f7924dd-15b3-4022-858a-8315ee93f599', 'volume_size': 1} Jul 08 10:51:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:30 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 Jul 08 10:51:30 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:31 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" returned: 0 in 1.296s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:31 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 1G Jul 08 10:51:31 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:32 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 1G" returned: 0 in 0.964s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:32 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 Jul 08 10:51:32 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:33 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879" returned: 0 in 0.883s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:33 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 is being set with open permissions: ugo+rw Jul 08 10:51:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:33 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 Jul 08 10:51:33 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:34 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879" returned: 0 in 0.811s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:34 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.info Jul 08 10:51:34 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:35 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.info" returned: 0 in 0.752s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:35 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.info is being set with open permissions: ugo+rw Jul 08 10:51:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:35 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.info Jul 08 10:51:35 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:36 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.info" returned: 0 in 0.979s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.862s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.672s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2050769919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7924dd-15b3-4022-858a-8315ee93f599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3ef4a8f1bf4f918baf68ba29968629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:30Z,use_quota=True,user_id='ec9e0824b4c84d94b32f0a02f43188f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Creating volume 4f7924dd-15b3-4022-858a-8315ee93f599 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:51:36 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:36 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 1073741824 Jul 08 10:51:36 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:36 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4ea183fe-62b2-4ffc-817b-d42c27e16a94 tempest-VolumesExtendTest-2006146690 None] Create snapshot completed successfully Jul 08 10:51:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-83db7549-b36c-4602-b3ad-b51c69bc0188 tempest-VolumesExtendTest-2006146690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:37 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 1073741824" returned: 0 in 0.950s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:37 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 Jul 08 10:51:37 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:38 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599" returned: 0 in 0.737s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-83db7549-b36c-4602-b3ad-b51c69bc0188 tempest-VolumesExtendTest-2006146690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.365s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee1ce0c-2d35-4f7e-9c3b-ac745b4f9f56]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83db7549-b36c-4602-b3ad-b51c69bc0188 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9be97b0-1164-402e-940b-0d1f12bcbf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f7924dd-15b3-4022-858a-8315ee93f599', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a37fb9-2aeb-4c5d-ae15-c264ed9c8e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:38 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Volume volume-4f7924dd-15b3-4022-858a-8315ee93f599 (4f7924dd-15b3-4022-858a-8315ee93f599): created successfully Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a37fb9-2aeb-4c5d-ae15-c264ed9c8e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Flow 'volume_create_manager' (ba58a036-f9b9-4d1d-a507-174645ffca8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:38 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-29758a6e-1b68-4b97-97d8-b52f9023e84e req-1e062bf9-bd28-45c1-8efe-85359291e178 tempest-VolumesSnapshotsTestJSON-1917412488 None] Created volume successfully. Jul 08 10:51:38 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 Jul 08 10:51:38 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:38 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83db7549-b36c-4602-b3ad-b51c69bc0188 tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" returned: 0 in 0.822s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83db7549-b36c-4602-b3ad-b51c69bc0188 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 2G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83db7549-b36c-4602-b3ad-b51c69bc0188 tempest-VolumesExtendTest-2006146690 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 2G" returned: 0 in 0.136s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-83db7549-b36c-4602-b3ad-b51c69bc0188 tempest-VolumesExtendTest-2006146690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.997s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-83db7549-b36c-4602-b3ad-b51c69bc0188 tempest-VolumesExtendTest-2006146690 None] Extend volume completed successfully. Jul 08 10:51:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] Creating offline snapshot 233a0653-7f63-49ec-8916-905431ed7fc6 of volume 4f7924dd-15b3-4022-858a-8315ee93f599 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:51:39 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c65e009-ec48-4709-8676-4c3ce8dfcf90]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:39 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 Jul 08 10:51:39 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Acquiring lock "cinder-e2611bc4-f853-4697-95a6-ce14469fc879-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Lock "cinder-e2611bc4-f853-4697-95a6-ce14469fc879-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Acquiring lock "cinder-quobyte-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Lock "cinder-quobyte-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Acquiring lock "cinder-quobyte-e2611bc4-f853-4697-95a6-ce14469fc879" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Lock "cinder-quobyte-e2611bc4-f853-4697-95a6-ce14469fc879" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Deleting offline snapshot e2611bc4-f853-4697-95a6-ce14469fc879 of volume c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] snapshot_file for this snap is: volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcd1d56-3fe9-40b3-b344-b8aec57ea512]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:40 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 Jul 08 10:51:40 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:40 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599" returned: 0 in 1.058s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:40 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 1G Jul 08 10:51:40 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Flow 'volume_create_manager' (ca4a1fe0-8714-4625-817e-516cbd8ad4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05218e52-cac3-462d-bae2-2687256af948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05218e52-cac3-462d-bae2-2687256af948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387a87f4-e1fe-4c23-8782-7edf03f13043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be6a4826c564d8f87592bd394caebed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:41Z,use_quota=True,user_id='3bbc35058fe948f39f72fb48d32797a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786e069a-3d4c-4824-92cf-cfae5c2b51b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786e069a-3d4c-4824-92cf-cfae5c2b51b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca8252f-2a79-4b8e-adf6-241e80528ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca8252f-2a79-4b8e-adf6-241e80528ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387a87f4-e1fe-4c23-8782-7edf03f13043', 'volume_name': 'volume-387a87f4-e1fe-4c23-8782-7edf03f13043', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e97d984-87da-41a3-9a20-6edccac5d067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e97d984-87da-41a3-9a20-6edccac5d067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d431ae56-c99f-4a83-8c57-60b043c3761b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:40 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Volume 387a87f4-e1fe-4c23-8782-7edf03f13043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387a87f4-e1fe-4c23-8782-7edf03f13043', 'volume_size': 1} Jul 08 10:51:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:41 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879" returned: 0 in 0.826s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:51:41 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89d168a-ee68-4570-9313-329e160c6d6d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:41 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 Jul 08 10:51:41 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:41 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 1G" returned: 0 in 0.883s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7924dd-15b3-4022-858a-8315ee93f599 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:41 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7924dd-15b3-4022-858a-8315ee93f599 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 Jul 08 10:51:41 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:41 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" returned: 0 in 0.768s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:42 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 Jul 08 10:51:42 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:42 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7924dd-15b3-4022-858a-8315ee93f599 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6" returned: 0 in 0.732s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:42 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 is being set with open permissions: ugo+rw Jul 08 10:51:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:42 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 Jul 08 10:51:42 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:42 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879" returned: 0 in 0.805s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:42 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879 Jul 08 10:51:42 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:42 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6" returned: 0 in 0.645s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:42 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.info Jul 08 10:51:42 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:43 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5.e2611bc4-f853-4697-95a6-ce14469fc879" returned: 0 in 0.711s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Lock "cinder-quobyte-e2611bc4-f853-4697-95a6-ce14469fc879" released by "_delete_snapshot" :: held 3.221s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Lock "cinder-quobyte-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" released by "delete_snapshot" :: held 3.250s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:43 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.info" returned: 0 in 0.657s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:43 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.info is being set with open permissions: ugo+rw Jul 08 10:51:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:43 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.info Jul 08 10:51:43 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:43 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Created reservations ['f0dc07ad-d9b4-4349-a052-c8a02aca3247', 'e56fba1f-cfa7-4cce-b533-5226be9ff93d', '24440dde-4550-4060-9487-b8d46d13ce4a', '76d43ec3-fc34-4f73-b902-4e6683ed7d38'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:51:43 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Delete snapshot completed successfully. Jul 08 10:51:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83c01934-c4e5-46f7-a9d7-c870f7b7d51f tempest-VolumesExtendTest-2006146690 None] Lock "cinder-e2611bc4-f853-4697-95a6-ce14469fc879-delete_snapshot" released by "delete_snapshot" :: held 3.428s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:44 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.info" returned: 0 in 0.659s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.735s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.435s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387a87f4-e1fe-4c23-8782-7edf03f13043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be6a4826c564d8f87592bd394caebed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:41Z,use_quota=True,user_id='3bbc35058fe948f39f72fb48d32797a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Creating volume 387a87f4-e1fe-4c23-8782-7edf03f13043 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:51:44 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:44 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043 1073741824 Jul 08 10:51:44 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:44 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-5320a0e9-dd2a-4d3c-baae-f363a560578a req-68a644ec-fc21-401f-bed1-0467ecb621b1 tempest-VolumesSnapshotsTestJSON-1917412488 None] Create snapshot completed successfully Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Acquiring lock "cinder-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Lock "cinder-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Acquiring lock "cinder-quobyte-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Lock "cinder-quobyte-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a17283-7577-4854-88c3-c3214f24f695]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:44 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 Jul 08 10:51:44 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:45 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043 1073741824" returned: 0 in 0.918s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:45 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043 Jul 08 10:51:45 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Acquiring lock "cinder-233a0653-7f63-49ec-8916-905431ed7fc6-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "cinder-233a0653-7f63-49ec-8916-905431ed7fc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Acquiring lock "cinder-quobyte-4f7924dd-15b3-4022-858a-8315ee93f599" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "cinder-quobyte-4f7924dd-15b3-4022-858a-8315ee93f599" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Acquiring lock "cinder-quobyte-233a0653-7f63-49ec-8916-905431ed7fc6" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "cinder-quobyte-233a0653-7f63-49ec-8916-905431ed7fc6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Deleting offline snapshot 233a0653-7f63-49ec-8916-905431ed7fc6 of volume 4f7924dd-15b3-4022-858a-8315ee93f599 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] snapshot_file for this snap is: volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4071579a-c2f7-4bcb-9aca-68dcea933f5b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:45 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" returned: 0 in 0.958s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:45 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5 Jul 08 10:51:45 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:45 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 Jul 08 10:51:45 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:45 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043" returned: 0 in 0.768s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:51:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d431ae56-c99f-4a83-8c57-60b043c3761b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387a87f4-e1fe-4c23-8782-7edf03f13043', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed404c8-d14b-4993-9c48-ead7ac688d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:46 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Volume volume-387a87f4-e1fe-4c23-8782-7edf03f13043 (387a87f4-e1fe-4c23-8782-7edf03f13043): created successfully Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed404c8-d14b-4993-9c48-ead7ac688d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Flow 'volume_create_manager' (ca4a1fe0-8714-4625-817e-516cbd8ad4ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-56f03b8f-449e-4204-b572-9546dc564821 tempest-CinderUnicodeTest-2008312636 None] Created volume successfully. Jul 08 10:51:46 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" returned: 0 in 0.786s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:46 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Lock "cinder-quobyte-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5" released by "delete_volume" :: held 1.810s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6" returned: 0 in 0.908s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f7924dd-15b3-4022-858a-8315ee93f599(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f279a148-89b8-4285-9212-4620a3cc230d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Created reservations ['6d805c45-7eb1-43e4-a167-26bddb5c3b73', '200f19e9-bef0-4c25-98c5-1d8ed452dae1', '53632cb8-7929-4ba9-97ef-611025763bce', 'aed8d019-31a7-4982-b199-ae6364d022aa'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:51:46 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 Jul 08 10:51:46 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:46 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:51:46 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:47 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:47 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.739s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599" returned: 0 in 0.878s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Deleted volume successfully. Jul 08 10:51:47 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 Jul 08 10:51:47 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5523a926-223d-43ea-974e-b9831b33e575 tempest-VolumesExtendTest-2006146690 None] Lock "cinder-c9c43a84-51a4-4480-a4d3-bb8976fc6ec5-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Flow 'volume_create_manager' (47748b9d-a8ac-4c49-86a6-0c0347be36ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb587b7-c6bb-4bc5-878c-efffd2ae6c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb587b7-c6bb-4bc5-878c-efffd2ae6c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-180292934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabf4a1c-e888-438f-81c9-ee01e4216387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be6a4826c564d8f87592bd394caebed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:48Z,use_quota=True,user_id='3bbc35058fe948f39f72fb48d32797a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7225db9f-1a44-4098-adfc-f3935d4e9bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7225db9f-1a44-4098-adfc-f3935d4e9bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ea3503-24d7-4231-b428-4bbc61a7f9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ea3503-24d7-4231-b428-4bbc61a7f9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aabf4a1c-e888-438f-81c9-ee01e4216387', 'volume_name': 'volume-aabf4a1c-e888-438f-81c9-ee01e4216387', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49e03b7-4898-4206-9d8b-e2fef7cb067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49e03b7-4898-4206-9d8b-e2fef7cb067e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee5c00a-bf94-4961-98b2-b19539cb908f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:47 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Volume aabf4a1c-e888-438f-81c9-ee01e4216387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aabf4a1c-e888-438f-81c9-ee01e4216387', 'volume_size': 1} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-180292934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabf4a1c-e888-438f-81c9-ee01e4216387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be6a4826c564d8f87592bd394caebed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:48Z,use_quota=True,user_id='3bbc35058fe948f39f72fb48d32797a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Creating volume aabf4a1c-e888-438f-81c9-ee01e4216387 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:51:47 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:51:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:47 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 1073741824 Jul 08 10:51:47 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:48 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6" returned: 0 in 0.976s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:48 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6 Jul 08 10:51:48 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:48 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 1073741824" returned: 0 in 1.035s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:48 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 Jul 08 10:51:48 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:49 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599.233a0653-7f63-49ec-8916-905431ed7fc6" returned: 0 in 0.824s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "cinder-quobyte-233a0653-7f63-49ec-8916-905431ed7fc6" released by "_delete_snapshot" :: held 3.725s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "cinder-quobyte-4f7924dd-15b3-4022-858a-8315ee93f599" released by "delete_snapshot" :: held 3.763s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.quota [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Created reservations ['7e6c2e84-4bcc-4c78-9e43-7dca28b0109f', '53a03881-e51b-4635-ad55-b5b9a2efb800', '5c3c08e1-64ed-4df1-a94e-1b8cc426d7fe', '65a2d359-3e9c-4216-a6b6-ed840f352758'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:51:49 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Delete snapshot completed successfully. Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-0b18efb5-7271-4c23-b609-09c7ffe18757 req-e563a419-6b5a-4450-81ec-560f638094bf tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "cinder-233a0653-7f63-49ec-8916-905431ed7fc6-delete_snapshot" released by "delete_snapshot" :: held 3.943s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:49 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387" returned: 0 in 0.792s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee5c00a-bf94-4961-98b2-b19539cb908f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabf4a1c-e888-438f-81c9-ee01e4216387', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac31130-4589-42d2-a3f4-7acbb0580363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:49 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Volume volume-aabf4a1c-e888-438f-81c9-ee01e4216387 (aabf4a1c-e888-438f-81c9-ee01e4216387): created successfully Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac31130-4589-42d2-a3f4-7acbb0580363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Flow 'volume_create_manager' (47748b9d-a8ac-4c49-86a6-0c0347be36ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:49 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5c0ccf87-db2b-46ba-bf46-65b2a1e798a6 tempest-CinderUnicodeTest-2008312636 None] Created volume successfully. Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Acquiring lock "cinder-4f7924dd-15b3-4022-858a-8315ee93f599-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "cinder-4f7924dd-15b3-4022-858a-8315ee93f599-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Acquiring lock "cinder-quobyte-4f7924dd-15b3-4022-858a-8315ee93f599" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "cinder-quobyte-4f7924dd-15b3-4022-858a-8315ee93f599" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea7980c-2ecd-4446-8ada-5e494f5e39c8]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:50 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 Jul 08 10:51:50 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (b9e1ef82-ebb7-4b99-bf2a-fe09f7a24c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fa4625-3039-4c3a-b2a2-53380f6fb531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fa4625-3039-4c3a-b2a2-53380f6fb531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1960056666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b546e5ab-b942-41a6-ae8d-b1dbd27ed60a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:50Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc27134-6d0c-400f-a53f-5a1ec02415d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc27134-6d0c-400f-a53f-5a1ec02415d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90c62ba-74fe-415d-8f7e-2253c6e8e6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90c62ba-74fe-415d-8f7e-2253c6e8e6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b546e5ab-b942-41a6-ae8d-b1dbd27ed60a', 'volume_name': 'volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d9c0fa-d68c-4c78-9c15-518f7e9aeb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d9c0fa-d68c-4c78-9c15-518f7e9aeb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70ea059-43b2-4e49-8858-d1c8ef3195cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:50 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Volume b546e5ab-b942-41a6-ae8d-b1dbd27ed60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a', 'volume_size': 1} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1960056666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b546e5ab-b942-41a6-ae8d-b1dbd27ed60a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:50Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Creating volume b546e5ab-b942-41a6-ae8d-b1dbd27ed60a {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:51:50 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:50 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a 1073741824 Jul 08 10:51:50 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:50 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599" returned: 0 in 0.859s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:50 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599 Jul 08 10:51:50 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:51 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a 1073741824" returned: 0 in 0.956s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:51 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f7924dd-15b3-4022-858a-8315ee93f599" returned: 0 in 0.707s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "cinder-quobyte-4f7924dd-15b3-4022-858a-8315ee93f599" released by "delete_volume" :: held 1.647s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:51 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a Jul 08 10:51:51 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG cinder.quota [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Created reservations ['27ed2714-878c-4d5d-9006-30754c67d920', '64c97375-7d5c-4a2f-a713-6342def847c9', 'cc648475-f797-4d3e-bd51-1ebb1cc2307e', '91b2d420-2914-4eb5-a1de-89d78f942080'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:51 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:51:51 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:52 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a" returned: 0 in 0.735s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.213s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70ea059-43b2-4e49-8858-d1c8ef3195cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c37226-6f40-4783-b964-754b8a809945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] Creating offline snapshot edbf9b15-47a2-4497-8dca-c1dd5b0fb264 of volume aabf4a1c-e888-438f-81c9-ee01e4216387 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:51:52 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Volume volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a (b546e5ab-b942-41a6-ae8d-b1dbd27ed60a): created successfully Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c37226-6f40-4783-b964-754b8a809945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (b9e1ef82-ebb7-4b99-bf2a-fe09f7a24c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c183054-a6d6-4ecb-84b0-137234f64e4a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:52 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-635c46d0-8d21-428d-bea6-40159e4d3970 tempest-VolumesGetTest-1284464337 None] Created volume successfully. Jul 08 10:51:52 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.865s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG cinder.manager [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:51:52 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Deleted volume successfully. Jul 08 10:51:52 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 Jul 08 10:51:52 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-f2c0b2b2-8551-4d58-8379-4c15f900b083 req-400950a8-8db1-4f30-baed-6224ae8090f7 tempest-VolumesSnapshotsTestJSON-1917412488 None] Lock "cinder-4f7924dd-15b3-4022-858a-8315ee93f599-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:51:53 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387" returned: 0 in 0.890s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:53 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 1G Jul 08 10:51:53 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (0522c006-01ec-49f4-8fab-2d4d263e821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e9a1fe-6ead-4eac-99aa-3919a804937a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e9a1fe-6ead-4eac-99aa-3919a804937a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1776127173',display_name='tempest-VolumesGetTest-Volume-808943917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e62ecf-0de9-4af4-a4bd-7a973a83d78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:53Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fe6600-99be-4ab8-8745-0cb210d0bd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fe6600-99be-4ab8-8745-0cb210d0bd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc16d021-aa87-455c-bc7a-53b81066db2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc16d021-aa87-455c-bc7a-53b81066db2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e62ecf-0de9-4af4-a4bd-7a973a83d78e', 'volume_name': 'volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78125c62-ee4f-4a61-bad8-4d7a81dca4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78125c62-ee4f-4a61-bad8-4d7a81dca4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97aff252-2fd8-4813-8034-b7ddf5f714f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:53 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Volume 02e62ecf-0de9-4af4-a4bd-7a973a83d78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e', 'volume_size': 1} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:53 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:51:53 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:54 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 1G" returned: 0 in 0.952s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabf4a1c-e888-438f-81c9-ee01e4216387 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:54 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabf4a1c-e888-438f-81c9-ee01e4216387 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 Jul 08 10:51:54 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:54 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.753s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:51:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:51:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:51:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:51:55 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabf4a1c-e888-438f-81c9-ee01e4216387 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264" returned: 0 in 0.823s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:55 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 is being set with open permissions: ugo+rw Jul 08 10:51:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:55 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 Jul 08 10:51:55 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f2c6b686-1029-4771-bd1b-e5cc09a256e2 req-9ba636e4-0911-48ae-88e2-8ddd6a39a6a9 tempest-TestStampPattern-920917405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:55 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264" returned: 0 in 0.716s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:55 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.info Jul 08 10:51:55 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Flow 'volume_create_manager' (06ec002e-269c-4641-8ee5-acc85a72a3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fd2477-daa1-410a-8078-521e324a721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fd2477-daa1-410a-8078-521e324a721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-321460846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2c901d6cc0e4432b11eaf6c3cb2bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:56Z,use_quota=True,user_id='fe7b02a5a9c64efdb80d8cbd15fcbfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e011a2-992a-4c88-9de6-5c4d23913f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e011a2-992a-4c88-9de6-5c4d23913f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431279d5-2842-4da1-92cf-a4572d5f2c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431279d5-2842-4da1-92cf-a4572d5f2c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5', 'volume_name': 'volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a441ee-f4ac-4a88-9e95-2c7e462a1bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:56 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a441ee-f4ac-4a88-9e95-2c7e462a1bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2243fcba-c1be-405b-93b3-384463e0126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:56 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Volume fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5', 'volume_size': 1} Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.info" returned: 0 in 0.738s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:56 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.info is being set with open permissions: ugo+rw Jul 08 10:51:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:56 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.info Jul 08 10:51:56 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:57 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.info" returned: 0 in 0.693s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.946s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.634s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1776127173',display_name='tempest-VolumesGetTest-Volume-808943917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e62ecf-0de9-4af4-a4bd-7a973a83d78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:53Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Creating volume 02e62ecf-0de9-4af4-a4bd-7a973a83d78e {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:51:57 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:57 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e 1073741824 Jul 08 10:51:57 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:57 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5f6743e0-758d-47b4-af24-f1be216c347d tempest-CinderUnicodeTest-2008312636 None] Create snapshot completed successfully Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "cinder-edbf9b15-47a2-4497-8dca-c1dd5b0fb264-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-edbf9b15-47a2-4497-8dca-c1dd5b0fb264-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "cinder-quobyte-aabf4a1c-e888-438f-81c9-ee01e4216387" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-quobyte-aabf4a1c-e888-438f-81c9-ee01e4216387" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "cinder-quobyte-edbf9b15-47a2-4497-8dca-c1dd5b0fb264" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-quobyte-edbf9b15-47a2-4497-8dca-c1dd5b0fb264" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Deleting offline snapshot edbf9b15-47a2-4497-8dca-c1dd5b0fb264 of volume aabf4a1c-e888-438f-81c9-ee01e4216387 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] snapshot_file for this snap is: volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[7576319a-d4fb-4fea-ae5c-eafa1de66458]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:57 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 Jul 08 10:51:57 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:58 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e 1073741824" returned: 0 in 0.815s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:58 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e Jul 08 10:51:58 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:58 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264" returned: 0 in 0.818s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aabf4a1c-e888-438f-81c9-ee01e4216387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3443445-9a10-49d0-a03c-9ee70c3aefcd]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:58 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 Jul 08 10:51:58 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:58 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e" returned: 0 in 0.714s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f2c6b686-1029-4771-bd1b-e5cc09a256e2 req-9ba636e4-0911-48ae-88e2-8ddd6a39a6a9 tempest-TestStampPattern-920917405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.311s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97aff252-2fd8-4813-8034-b7ddf5f714f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd28378f-0770-42d8-b25e-b156ac416f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6172615d-f427-4d3f-9388-522c09d01b1e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f2c6b686-1029-4771-bd1b-e5cc09a256e2 req-9ba636e4-0911-48ae-88e2-8ddd6a39a6a9 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:58 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Volume volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e (02e62ecf-0de9-4af4-a4bd-7a973a83d78e): created successfully Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd28378f-0770-42d8-b25e-b156ac416f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:51:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (0522c006-01ec-49f4-8fab-2d4d263e821f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:51:58 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-7aaf80f6-76b0-4645-be00-e5704321939c tempest-VolumesGetTest-1284464337 None] Created volume successfully. Jul 08 10:51:59 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 Jul 08 10:51:59 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:59 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387" returned: 0 in 0.849s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:59 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 Jul 08 10:51:59 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:59 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-f2c6b686-1029-4771-bd1b-e5cc09a256e2 req-9ba636e4-0911-48ae-88e2-8ddd6a39a6a9 tempest-TestStampPattern-920917405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32" returned: 0 in 0.852s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-f2c6b686-1029-4771-bd1b-e5cc09a256e2 req-9ba636e4-0911-48ae-88e2-8ddd6a39a6a9 tempest-TestStampPattern-920917405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.883s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.179s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-321460846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2c901d6cc0e4432b11eaf6c3cb2bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:51:56Z,use_quota=True,user_id='fe7b02a5a9c64efdb80d8cbd15fcbfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Creating volume fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:51:59 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:51:59 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5 1073741824 Jul 08 10:51:59 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:51:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f2c6b686-1029-4771-bd1b-e5cc09a256e2 req-9ba636e4-0911-48ae-88e2-8ddd6a39a6a9 tempest-TestStampPattern-920917405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0956700-a2cd-4269-889e-d85a0d565252', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:51:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-f2c6b686-1029-4771-bd1b-e5cc09a256e2 req-9ba636e4-0911-48ae-88e2-8ddd6a39a6a9 tempest-TestStampPattern-920917405 None] attachment_update completed successfully. Jul 08 10:52:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-02e62ecf-0de9-4af4-a4bd-7a973a83d78e-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Lock "cinder-02e62ecf-0de9-4af4-a4bd-7a973a83d78e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-quobyte-02e62ecf-0de9-4af4-a4bd-7a973a83d78e" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-02e62ecf-0de9-4af4-a4bd-7a973a83d78e" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:00 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[60473d4c-fd22-46c3-83a5-46e2c247a5d3]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:00 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e Jul 08 10:52:00 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:00 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264" returned: 0 in 0.953s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:00 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264 Jul 08 10:52:00 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:00 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5 1073741824" returned: 0 in 0.938s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:00 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5 Jul 08 10:52:00 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:01 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e" returned: 0 in 0.882s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:01 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e Jul 08 10:52:01 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:01 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387.edbf9b15-47a2-4497-8dca-c1dd5b0fb264" returned: 0 in 0.791s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-quobyte-edbf9b15-47a2-4497-8dca-c1dd5b0fb264" released by "_delete_snapshot" :: held 3.589s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-quobyte-aabf4a1c-e888-438f-81c9-ee01e4216387" released by "delete_snapshot" :: held 3.613s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Created reservations ['61470f86-fce6-4a19-b8a4-bad755ff619c', '96718553-4923-4c6f-859f-bd5bc3536189', '932d588e-7bef-43d8-b9b8-89b9940b1653', '2ddae5e5-8153-4d6a-a5a0-da562fbd77ea'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:01 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Delete snapshot completed successfully. Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-699f8e1f-794c-43b1-9eeb-a98ff6d60576 tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-edbf9b15-47a2-4497-8dca-c1dd5b0fb264-delete_snapshot" released by "delete_snapshot" :: held 3.766s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:01 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5" returned: 0 in 0.731s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2243fcba-c1be-405b-93b3-384463e0126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1c2aac-9b9a-4d19-a4ed-d23ab63f2009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:01 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Volume volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5 (fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5): created successfully Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1c2aac-9b9a-4d19-a4ed-d23ab63f2009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Flow 'volume_create_manager' (06ec002e-269c-4641-8ee5-acc85a72a3ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:01 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8750a554-8824-47bf-8c36-41f1e5c0b377 tempest-VolumesTestJSON-194701318 None] Created volume successfully. Jul 08 10:52:01 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-02e62ecf-0de9-4af4-a4bd-7a973a83d78e" returned: 0 in 0.760s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-02e62ecf-0de9-4af4-a4bd-7a973a83d78e" released by "delete_volume" :: held 1.695s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "cinder-aabf4a1c-e888-438f-81c9-ee01e4216387-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-aabf4a1c-e888-438f-81c9-ee01e4216387-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "cinder-quobyte-aabf4a1c-e888-438f-81c9-ee01e4216387" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Created reservations ['5fdcf607-4f67-4f67-abed-a0df788ee238', '9cfb1c2e-2b87-4733-a2f2-e4706292bdbc', '299e10a7-3305-4ab9-bdee-c1608686f47b', '3114f80c-c1cc-446e-ab2e-8e224a4c45de'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-quobyte-aabf4a1c-e888-438f-81c9-ee01e4216387" acquired by "delete_volume" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb66612-5b5c-4275-be24-2b38613ede8f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:02 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:02 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:02 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 Jul 08 10:52:02 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Lock "cinder-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Flow 'volume_create_manager' (4f067a81-e1b3-4f80-84af-6212566493fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7bcddf-da66-4b58-b522-25875f5b732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-quobyte-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7bcddf-da66-4b58-b522-25875f5b732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-640353452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99b4e28-1dbe-4ae1-88b4-a138c23395f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2c901d6cc0e4432b11eaf6c3cb2bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:02Z,use_quota=True,user_id='fe7b02a5a9c64efdb80d8cbd15fcbfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4bd23f-e2e3-4fd7-9378-06519be8efa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4bd23f-e2e3-4fd7-9378-06519be8efa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7543cc-7d3d-4309-bd13-db21daaa0f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7543cc-7d3d-4309-bd13-db21daaa0f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99b4e28-1dbe-4ae1-88b4-a138c23395f1', 'volume_name': 'volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63f14a3-b8b3-4f79-b377-7e6baecf9a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63f14a3-b8b3-4f79-b377-7e6baecf9a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8965708a-bccd-4646-a565-55c52007d4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:02 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Volume c99b4e28-1dbe-4ae1-88b4-a138c23395f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1', 'volume_size': 1} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-640353452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99b4e28-1dbe-4ae1-88b4-a138c23395f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2c901d6cc0e4432b11eaf6c3cb2bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:02Z,use_quota=True,user_id='fe7b02a5a9c64efdb80d8cbd15fcbfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Creating volume c99b4e28-1dbe-4ae1-88b4-a138c23395f1 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:52:02 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a" acquired by "delete_volume" :: waited 0.082s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:02 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1 1073741824 Jul 08 10:52:02 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[372e3477-0260-4a73-b25a-48b3508fd89e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:02 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a Jul 08 10:52:02 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:03 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.960s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:03 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387" returned: 0 in 1.038s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:03 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Deleted volume successfully. Jul 08 10:52:03 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387 Jul 08 10:52:03 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55442754-5820-4c6d-ab1f-135ee589d495 tempest-VolumesGetTest-1284464337 None] Lock "cinder-02e62ecf-0de9-4af4-a4bd-7a973a83d78e-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:03 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1 1073741824" returned: 0 in 0.992s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:03 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a" returned: 0 in 0.953s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:03 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a Jul 08 10:52:03 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:03 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-aabf4a1c-e888-438f-81c9-ee01e4216387" returned: 0 in 0.755s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-quobyte-aabf4a1c-e888-438f-81c9-ee01e4216387" released by "delete_volume" :: held 1.854s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:03 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1 Jul 08 10:52:03 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:03 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Created reservations ['5617dca0-e022-46fc-a5cb-04b06fa2fedd', 'b9a7969e-03ed-40dd-bac9-b123eec875ab', '44bf2b2f-58fb-4014-82f5-e21ad9cb81f4', 'fe02d07d-2914-4b41-9a9d-1064b3fae73f'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:04 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:04 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "cinder-387a87f4-e1fe-4c23-8782-7edf03f13043-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-387a87f4-e1fe-4c23-8782-7edf03f13043-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "cinder-quobyte-387a87f4-e1fe-4c23-8782-7edf03f13043" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-quobyte-387a87f4-e1fe-4c23-8782-7edf03f13043" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9eb5946-3bbd-405c-878e-27a3b246db21]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:04 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a" returned: 0 in 0.765s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a" released by "delete_volume" :: held 1.801s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Created reservations ['7e9505e6-8e46-43dd-81bf-babf085af039', 'ebabcdfa-f3af-4a0f-aba3-1229347a4948', 'f01292d7-ceb5-4572-bda5-e21a3c37fd15', '2cc65093-0392-4711-b48d-4fc08c4e056e'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:04 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043 Jul 08 10:52:04 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:04 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:04 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:04 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1" returned: 0 in 0.823s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8965708a-bccd-4646-a565-55c52007d4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a058e378-3a98-41c3-82d0-5d9357bb108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:04 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Volume volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1 (c99b4e28-1dbe-4ae1-88b4-a138c23395f1): created successfully Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a058e378-3a98-41c3-82d0-5d9357bb108c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Flow 'volume_create_manager' (4f067a81-e1b3-4f80-84af-6212566493fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:04 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-755a44c2-a76f-42c7-9f52-531aa2429ffc tempest-VolumesTestJSON-194701318 None] Created volume successfully. Jul 08 10:52:04 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.866s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:04 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Deleted volume successfully. Jul 08 10:52:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-144a4ded-e957-40a1-9249-dadfc2721d1e tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-aabf4a1c-e888-438f-81c9-ee01e4216387-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:52:05 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (d9d122a5-8b3c-4dd9-9f91-c06e7a5bf987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee6d5bc-ace7-450b-912f-27812e229262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043" returned: 0 in 1.088s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee6d5bc-ace7-450b-912f-27812e229262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1315636964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99635ce3-7f33-4438-9663-9c20ba177046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:05Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:05 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043 Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bf6d34-2354-44d4-ad4c-3146e9bc8cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:05 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bf6d34-2354-44d4-ad4c-3146e9bc8cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847a411a-5f18-4567-be59-b5f2676ffc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847a411a-5f18-4567-be59-b5f2676ffc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99635ce3-7f33-4438-9663-9c20ba177046', 'volume_name': 'volume-99635ce3-7f33-4438-9663-9c20ba177046', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b85a63a-d622-4b49-9927-0935434267c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:05 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b85a63a-d622-4b49-9927-0935434267c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352fbb1d-7c19-455e-b079-8b79ff2676b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:05 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Volume 99635ce3-7f33-4438-9663-9c20ba177046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99635ce3-7f33-4438-9663-9c20ba177046', 'volume_size': 1} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1315636964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99635ce3-7f33-4438-9663-9c20ba177046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:05Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Creating volume 99635ce3-7f33-4438-9663-9c20ba177046 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:52:05 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.904s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Deleted volume successfully. Jul 08 10:52:05 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 1073741824 Jul 08 10:52:05 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fb5852f-6cd4-4116-bb7c-57de88f492ff tempest-VolumesGetTest-1284464337 None] Lock "cinder-b546e5ab-b942-41a6-ae8d-b1dbd27ed60a-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:06 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-387a87f4-e1fe-4c23-8782-7edf03f13043" returned: 0 in 0.815s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-quobyte-387a87f4-e1fe-4c23-8782-7edf03f13043" released by "delete_volume" :: held 1.949s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Created reservations ['83fcf872-e8ae-40c6-95a7-5f6296d21a39', '59c5f473-c07a-4090-9f93-c54caf388e17', '29bf3a0f-2bf8-4e1b-8016-a2210f77cd3d', '868e6b2c-cb8a-4282-b4ce-a1b75457cd46'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Flow 'volume_create_manager' (e8178165-0a07-4aee-8db3-4f182c5625b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d9649a-07d5-49b4-b220-1e2dcfa191c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d9649a-07d5-49b4-b220-1e2dcfa191c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1593201299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2c901d6cc0e4432b11eaf6c3cb2bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:06Z,use_quota=True,user_id='fe7b02a5a9c64efdb80d8cbd15fcbfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e27193-7598-4a45-b452-e3e2f44f00d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e27193-7598-4a45-b452-e3e2f44f00d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8b8ced-aab9-41f4-9d89-6f2c50f9777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8b8ced-aab9-41f4-9d89-6f2c50f9777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7', 'volume_name': 'volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7531fe08-3390-46c7-877a-eb2c877320ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7531fe08-3390-46c7-877a-eb2c877320ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ca2e2b-6449-4fcb-9e6b-b28c918bd86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:06 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Volume 64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7', 'volume_size': 1} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:06 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:06 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:06 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 1073741824" returned: 0 in 1.116s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:06 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 Jul 08 10:52:06 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:07 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.719s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:07 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Deleted volume successfully. Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-244a66d2-e09e-4d73-877b-0d0bc09adfbd tempest-CinderUnicodeTest-2008312636 None] Lock "cinder-387a87f4-e1fe-4c23-8782-7edf03f13043-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:07 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046" returned: 0 in 0.824s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1593201299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2c901d6cc0e4432b11eaf6c3cb2bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:06Z,use_quota=True,user_id='fe7b02a5a9c64efdb80d8cbd15fcbfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Creating volume 64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:52:07 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:07 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7 1073741824 Jul 08 10:52:07 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352fbb1d-7c19-455e-b079-8b79ff2676b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99635ce3-7f33-4438-9663-9c20ba177046', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7787203d-1f4c-4e31-9376-4c5f60c766a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:07 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Volume volume-99635ce3-7f33-4438-9663-9c20ba177046 (99635ce3-7f33-4438-9663-9c20ba177046): created successfully Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7787203d-1f4c-4e31-9376-4c5f60c766a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (d9d122a5-8b3c-4dd9-9f91-c06e7a5bf987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:07 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ef35381f-3139-4184-b3e5-cdbdb17a45e5 tempest-VolumesGetTest-1284464337 None] Created volume successfully. Jul 08 10:52:07 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-177a56d4-efe8-46ff-b9af-4dd24a4b694c req-64204bca-6ea0-409a-9f77-445e6ebca3b5 tempest-TestStampPattern-920917405 None] Terminate volume connection completed successfully. Jul 08 10:52:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-177a56d4-efe8-46ff-b9af-4dd24a4b694c req-64204bca-6ea0-409a-9f77-445e6ebca3b5 tempest-TestStampPattern-920917405 None] Deleting attachment a0956700-a2cd-4269-889e-d85a0d565252. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:52:08 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7 1073741824" returned: 0 in 1.035s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:08 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7 Jul 08 10:52:08 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (fdfc01f0-c273-49ef-a95a-c384238aa435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de4cd9c-36ed-4f55-8bfb-1ec8351f250d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de4cd9c-36ed-4f55-8bfb-1ec8351f250d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1327887324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1118fed6-6673-4926-878f-c695f022c7c8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=99635ce3-7f33-4438-9663-9c20ba177046,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:09Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d489273b-3206-426e-81bd-b16f41e32a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d489273b-3206-426e-81bd-b16f41e32a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125446da-67c6-431e-a2b2-b16f275b6cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125446da-67c6-431e-a2b2-b16f275b6cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1118fed6-6673-4926-878f-c695f022c7c8', 'volume_name': 'volume-1118fed6-6673-4926-878f-c695f022c7c8', 'volume_size': 1, 'source_volid': '99635ce3-7f33-4438-9663-9c20ba177046', 'source_volstatus': 'available'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273d8ca0-4900-44c5-8908-12925cd73be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273d8ca0-4900-44c5-8908-12925cd73be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7076b51b-5f77-425e-9b73-02d1851809af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:09 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Volume 1118fed6-6673-4926-878f-c695f022c7c8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1118fed6-6673-4926-878f-c695f022c7c8', 'volume_size': 1, 'source_volid': '99635ce3-7f33-4438-9663-9c20ba177046', 'source_volstatus': 'available'} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:09 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7" returned: 0 in 0.812s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.029s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:09 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Cloning volume 99635ce3-7f33-4438-9663-9c20ba177046 to volume 1118fed6-6673-4926-878f-c695f022c7c8 Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ca2e2b-6449-4fcb-9e6b-b28c918bd86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aed23d5-1198-456c-ac85-aa15b3fce0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:09 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Volume volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7 (64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7): created successfully Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aed23d5-1198-456c-ac85-aa15b3fce0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Flow 'volume_create_manager' (e8178165-0a07-4aee-8db3-4f182c5625b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Creating offline snapshot 78348181-abc6-4362-b0fa-114f78d67141 of volume 99635ce3-7f33-4438-9663-9c20ba177046 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:52:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-925947f4-5c17-4b6d-b3ad-4c6fccbbb501 tempest-VolumesTestJSON-194701318 None] Created volume successfully. Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b2a970-a804-4e03-a230-b0b9acab28d2]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:09 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 Jul 08 10:52:09 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:10 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046" returned: 0 in 0.953s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:10 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 1G Jul 08 10:52:10 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:11 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 1G" returned: 0 in 1.361s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99635ce3-7f33-4438-9663-9c20ba177046 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:11 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99635ce3-7f33-4438-9663-9c20ba177046 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 Jul 08 10:52:11 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Acquiring lock "cinder-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Lock "cinder-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Acquiring lock "cinder-quobyte-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Lock "cinder-quobyte-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7" acquired by "delete_volume" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:12 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac98d81d-8fd6-4a35-a419-55f175e8f127]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:12 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7 Jul 08 10:52:12 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:12 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99635ce3-7f33-4438-9663-9c20ba177046 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141" returned: 0 in 0.887s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:12 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 is being set with open permissions: ugo+rw Jul 08 10:52:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:12 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 Jul 08 10:52:12 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:13 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7" returned: 0 in 1.083s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:13 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7 Jul 08 10:52:13 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:13 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141" returned: 0 in 1.073s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:13 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.info Jul 08 10:52:13 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:14 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7" returned: 0 in 0.937s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Lock "cinder-quobyte-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7" released by "delete_volume" :: held 2.096s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:14 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Created reservations ['95c01351-df6d-4a3f-885c-2eb890fbf3fd', '595e7810-c863-4bf9-9ce2-2103ea6980ab', '8c1c649f-a854-4833-8549-a85d906ef495', 'c8a6431a-db5e-4b0a-b851-95b5c533f703'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:14 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:14 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:14 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.info" returned: 0 in 0.968s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:14 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.info is being set with open permissions: ugo+rw Jul 08 10:52:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:14 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.info Jul 08 10:52:14 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:15 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.738s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:15 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Deleted volume successfully. Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-811ac77b-8482-4236-898f-f3c6c7896061 tempest-VolumesTestJSON-194701318 None] Lock "cinder-64fcf7d3-8bbe-46d8-bb47-7c137a4d30d7-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Acquiring lock "cinder-c99b4e28-1dbe-4ae1-88b4-a138c23395f1-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Lock "cinder-c99b4e28-1dbe-4ae1-88b4-a138c23395f1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Acquiring lock "cinder-quobyte-c99b4e28-1dbe-4ae1-88b4-a138c23395f1" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Lock "cinder-quobyte-c99b4e28-1dbe-4ae1-88b4-a138c23395f1" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea073b50-3bad-4a11-8e78-c84e6a65b79c]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:15 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.info" returned: 0 in 0.780s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-quobyte-1118fed6-6673-4926-878f-c695f022c7c8" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:15 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1 Jul 08 10:52:15 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-1118fed6-6673-4926-878f-c695f022c7c8" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] snapshot: 78348181-abc6-4362-b0fa-114f78d67141, volume: 1118fed6-6673-4926-878f-c695f022c7c8, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bbd78e-9b93-44a0-87f9-28768de7e8de]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:15 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 Jul 08 10:52:15 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:16 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1" returned: 0 in 0.859s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:16 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1 Jul 08 10:52:16 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:16 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141" returned: 0 in 0.954s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99635ce3-7f33-4438-9663-9c20ba177046(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:52:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 10:52:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 10:52:16 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b544edea-87f7-4e6b-a820-11e03ee4383f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:16 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 Jul 08 10:52:16 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:17 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c99b4e28-1dbe-4ae1-88b4-a138c23395f1" returned: 0 in 0.824s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Lock "cinder-quobyte-c99b4e28-1dbe-4ae1-88b4-a138c23395f1" released by "delete_volume" :: held 1.746s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Created reservations ['0e15c250-83b7-4bc0-824f-ef83a3b59228', '591aa9da-2b82-41b5-b3c7-13c189c90f67', '7f7be98f-4541-4c87-a86c-2e12feaf92d3', '62700031-e6ab-4160-af35-1167da7337d9'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:17 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:17 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:17 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046" returned: 0 in 0.979s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8 not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Acquiring lock "cinder-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:17 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8 Jul 08 10:52:17 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Lock "cinder-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Acquiring lock "cinder-quobyte-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Lock "cinder-quobyte-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fabbde6-5c28-4153-8715-aa36b1bd4501]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Acquiring lock "cinder-d3a5febd-9c9b-46e2-ae66-162350d3fb32-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Lock "cinder-d3a5febd-9c9b-46e2-ae66-162350d3fb32-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:18 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5 Jul 08 10:52:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Acquiring lock "cinder-quobyte-d3a5febd-9c9b-46e2-ae66-162350d3fb32" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:18 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-d3a5febd-9c9b-46e2-ae66-162350d3fb32" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:18 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b5fb3f-8db4-4276-9f18-2968f5dcd654]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:18 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.995s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:18 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Deleted volume successfully. Jul 08 10:52:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ef315a52-4ad8-4729-a0bd-63eec8ddc047 tempest-VolumesTestJSON-194701318 None] Lock "cinder-c99b4e28-1dbe-4ae1-88b4-a138c23395f1-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:18 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 Jul 08 10:52:18 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:19 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5" returned: 0 in 1.790s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:19 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5 Jul 08 10:52:19 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:20 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32" returned: 0 in 1.761s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:20 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32 Jul 08 10:52:20 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:21 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5" returned: 0 in 1.788s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Lock "cinder-quobyte-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5" released by "delete_volume" :: held 3.695s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:21 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Created reservations ['38a3b87c-945d-438a-8ed7-f3810499a271', 'e34be7db-e521-467b-a81a-f033830104c7', '9ae3b33d-e841-40f7-8442-70f278d5d856', 'e44e50a2-bf0a-4a9b-89a9-de01634dd966'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:21 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d3a5febd-9c9b-46e2-ae66-162350d3fb32" returned: 0 in 1.750s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-d3a5febd-9c9b-46e2-ae66-162350d3fb32" released by "delete_volume" :: held 3.628s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:22 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Created reservations ['92e35dc8-90fc-4107-8e0e-8d594229f8a2', 'a550d63e-1869-49b5-b767-c79820fa4804', '05c49097-8896-4da5-9c19-ac3237209b39', '84cb71c3-e44b-41ca-8776-f8b405de8f61'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:22 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:22 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:22 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:22 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:24 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.737s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:24 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Deleted volume successfully. Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=110,cinder:INSERT=35,cinder:UPDATE=146,cinder:DELETE=12 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:52:24 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 2.260s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:24 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Deleted volume successfully. Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-bc2c69bb-ade6-461b-a923-eaeecd1ef4b5 tempest-TestStampPattern-920917405 None] Lock "cinder-d3a5febd-9c9b-46e2-ae66-162350d3fb32-delete_volume" released by "delete_volume" :: held 6.236s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6a3cbf8f-9550-479c-bc6d-dd18e93e5731 tempest-VolumesTestJSON-194701318 None] Lock "cinder-fea4beaa-41a7-4cb2-8ad9-58f01fffb6a5-delete_volume" released by "delete_volume" :: held 6.642s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Acquiring lock "cinder-d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Lock "cinder-d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.102s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Acquiring lock "cinder-quobyte-543a6ee4-6bd5-4e26-8078-d227d360a757" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-543a6ee4-6bd5-4e26-8078-d227d360a757" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Acquiring lock "cinder-quobyte-d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Deleting offline snapshot d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c of volume 543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] snapshot_file for this snap is: volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[224ecbb2-2f2d-4981-bb0d-4b7a396ed825]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:24 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c Jul 08 10:52:24 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:25 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8" returned: 0 in 7.620s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:25 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[755449f9-addf-4dbc-b98b-a00882cad28d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:25 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 Jul 08 10:52:25 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:25 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c" returned: 0 in 1.078s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-543a6ee4-6bd5-4e26-8078-d227d360a757(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:52:25 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1682f6-406f-4164-8155-322958afdc24]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:26 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 Jul 08 10:52:26 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:26 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046" returned: 0 in 1.301s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:26 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046, size 1024.00 MB, duration 7.62 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:52:26 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Converted 1024.00 MB image at 134.36 MB/s Jul 08 10:52:26 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8 is being set with open permissions: ugo+rw Jul 08 10:52:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:26 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8 Jul 08 10:52:26 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:27 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757" returned: 0 in 1.116s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:27 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c Jul 08 10:52:27 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:27 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8" returned: 0 in 0.886s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-1118fed6-6673-4926-878f-c695f022c7c8" released by "_copy_volume_from_snapshot" :: held 11.879s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-quobyte-78348181-abc6-4362-b0fa-114f78d67141" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-78348181-abc6-4362-b0fa-114f78d67141" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Deleting offline snapshot 78348181-abc6-4362-b0fa-114f78d67141 of volume 99635ce3-7f33-4438-9663-9c20ba177046 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:52:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] snapshot_file for this snap is: volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:52:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da51d21-e6cc-4e63-8ce3-3524f3ce4dc2]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:27 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 Jul 08 10:52:27 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:28 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c" returned: 0 in 1.234s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:28 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c Jul 08 10:52:28 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:28 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141" returned: 0 in 1.091s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99635ce3-7f33-4438-9663-9c20ba177046(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:52:28 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5088910f-8178-44ab-8291-e2216d9afc9e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:28 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 Jul 08 10:52:28 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:29 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757.d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c" returned: 0 in 0.877s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:29 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:INSERT=40,cinder:UPDATE=157,cinder:SELECT=125,cinder:DELETE=13 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:52:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c" released by "_delete_snapshot" :: held 4.523s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-543a6ee4-6bd5-4e26-8078-d227d360a757" released by "delete_snapshot" :: held 4.598s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:29 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Created reservations ['2964ffc5-7e1c-466a-82aa-b7c314ebf64f', 'bea3757c-1291-43b7-bc18-8b6b15c2294c', '7e0dab2c-19b9-494d-86ed-3485bcf80b33', '90fce2eb-9c61-4ca4-a47a-7087b75586cf'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Delete snapshot completed successfully. Jul 08 10:52:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c915b85-1ae9-484d-90a3-d76cfcce9cb4 tempest-TestStampPattern-920917405 None] Lock "cinder-d2ffde36-bbcd-485a-9cb0-bd1cb40e0e7c-delete_snapshot" released by "delete_snapshot" :: held 4.835s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:29 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046" returned: 0 in 1.026s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:29 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 Jul 08 10:52:29 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:30 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141" returned: 0 in 0.936s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:30 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141 Jul 08 10:52:30 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:31 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046.78348181-abc6-4362-b0fa-114f78d67141" returned: 0 in 0.849s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-78348181-abc6-4362-b0fa-114f78d67141" released by "_delete_snapshot" :: held 4.022s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.256s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7076b51b-5f77-425e-9b73-02d1851809af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1118fed6-6673-4926-878f-c695f022c7c8', 'volume_size': 1, 'source_volid': '99635ce3-7f33-4438-9663-9c20ba177046', 'source_volstatus': 'available'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a14a6a3-be6f-4727-bc38-ad6db79c8138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:31 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Volume volume-1118fed6-6673-4926-878f-c695f022c7c8 (1118fed6-6673-4926-878f-c695f022c7c8): created successfully Jul 08 10:52:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a14a6a3-be6f-4727-bc38-ad6db79c8138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (fdfc01f0-c273-49ef-a95a-c384238aa435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:31 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-de586a09-4e4f-419e-8140-fa962ed180a0 tempest-VolumesGetTest-1284464337 None] Created volume successfully. Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (7d0ccaad-69fb-403c-a20f-3026e3ae07ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6547edc2-6ce6-41ac-885d-36cf8c14aee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6547edc2-6ce6-41ac-885d-36cf8c14aee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1794843735',display_name='tempest-VolumesGetTest-Volume-674259996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383b465d-1afc-40d7-b657-cb231c4a22e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:34Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f1e6dd-ed10-4ab1-8f21-ef7670c72dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f1e6dd-ed10-4ab1-8f21-ef7670c72dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c4139e-01b6-4383-b654-68089501c998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c4139e-01b6-4383-b654-68089501c998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383b465d-1afc-40d7-b657-cb231c4a22e6', 'volume_name': 'volume-383b465d-1afc-40d7-b657-cb231c4a22e6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdbc315-7a59-4742-afbe-0b8263322172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdbc315-7a59-4742-afbe-0b8263322172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7baf4f-5ebe-4664-a8fa-7079221696dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:34 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Volume 383b465d-1afc-40d7-b657-cb231c4a22e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383b465d-1afc-40d7-b657-cb231c4a22e6', 'volume_size': 1} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1794843735',display_name='tempest-VolumesGetTest-Volume-674259996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383b465d-1afc-40d7-b657-cb231c4a22e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:34Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Creating volume 383b465d-1afc-40d7-b657-cb231c4a22e6 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:52:34 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:52:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:34 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6 1073741824 Jul 08 10:52:34 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:35 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6 1073741824" returned: 0 in 1.090s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:35 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6 Jul 08 10:52:35 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:36 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6ea202fe-bab8-495a-b30e-7ce02ac6f813 tempest-GroupSnapshotsV319Test-1511654561 None] Group tempest-GroupSnapshotsV319Test-Group-697876023: creating Jul 08 10:52:36 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6ea202fe-bab8-495a-b30e-7ce02ac6f813 tempest-GroupSnapshotsV319Test-1511654561 None] Group tempest-GroupSnapshotsV319Test-Group-697876023: created successfully Jul 08 10:52:36 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6ea202fe-bab8-495a-b30e-7ce02ac6f813 tempest-GroupSnapshotsV319Test-1511654561 None] Create group completed successfully. Jul 08 10:52:36 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6" returned: 0 in 1.010s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:52:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7baf4f-5ebe-4664-a8fa-7079221696dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383b465d-1afc-40d7-b657-cb231c4a22e6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6815669a-86b8-439b-9896-cbf61425423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:36 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Volume volume-383b465d-1afc-40d7-b657-cb231c4a22e6 (383b465d-1afc-40d7-b657-cb231c4a22e6): created successfully Jul 08 10:52:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6815669a-86b8-439b-9896-cbf61425423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (7d0ccaad-69fb-403c-a20f-3026e3ae07ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:36 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-7063b809-63aa-4fca-9a8f-878d8014a2ac tempest-VolumesGetTest-1284464337 None] Created volume successfully. Jul 08 10:52:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-383b465d-1afc-40d7-b657-cb231c4a22e6-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Lock "cinder-383b465d-1afc-40d7-b657-cb231c4a22e6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-quobyte-383b465d-1afc-40d7-b657-cb231c4a22e6" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-383b465d-1afc-40d7-b657-cb231c4a22e6" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:37 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fced10-826b-494c-b5b2-54b090ae79d8]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:37 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6 Jul 08 10:52:37 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Flow 'volume_create_manager' (f39c26e3-8a1a-4296-bebe-ff0152e4a901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b76e330-fa4b-4aaa-a6c2-340a38582d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b76e330-fa4b-4aaa-a6c2-340a38582d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1449507269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=533f0920-8bb8-4e24-ae45-806c1afc06e0,host='devstack@QuobyteHD#QuobyteHD',id=dcd3def4-b9ed-4886-8754-b64459099608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56427860f054bd68660479c48767c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:38Z,use_quota=True,user_id='6d6029de199b409f931c96f94897b3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cb70582-e6e8-4d6a-bb73-041128960e4a),volume_type_id=3cb70582-e6e8-4d6a-bb73-041128960e4a)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8a2d06-bae4-4fd0-90a0-52ddc576704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8a2d06-bae4-4fd0-90a0-52ddc576704b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d26689-c758-4339-97ca-645766b4a07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d26689-c758-4339-97ca-645766b4a07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd3def4-b9ed-4886-8754-b64459099608', 'volume_name': 'volume-dcd3def4-b9ed-4886-8754-b64459099608', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6647a27f-3d73-42b9-96df-152ef921c32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6647a27f-3d73-42b9-96df-152ef921c32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e6e666-8bb8-49ba-849b-9939536eef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:38 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Volume dcd3def4-b9ed-4886-8754-b64459099608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd3def4-b9ed-4886-8754-b64459099608', 'volume_size': 1} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=533f0920-8bb8-4e24-ae45-806c1afc06e0,created_at=2026-07-08T08:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1449507269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=533f0920-8bb8-4e24-ae45-806c1afc06e0,host='devstack@QuobyteHD#QuobyteHD',id=dcd3def4-b9ed-4886-8754-b64459099608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56427860f054bd68660479c48767c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:38Z,use_quota=True,user_id='6d6029de199b409f931c96f94897b3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cb70582-e6e8-4d6a-bb73-041128960e4a),volume_type_id=3cb70582-e6e8-4d6a-bb73-041128960e4a)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Creating volume dcd3def4-b9ed-4886-8754-b64459099608 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:52:38 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:38 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 1073741824 Jul 08 10:52:38 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Acquiring lock "cinder-543a6ee4-6bd5-4e26-8078-d227d360a757-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Lock "cinder-543a6ee4-6bd5-4e26-8078-d227d360a757-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Acquiring lock "cinder-quobyte-543a6ee4-6bd5-4e26-8078-d227d360a757" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-543a6ee4-6bd5-4e26-8078-d227d360a757" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[561b6bef-49f1-4b4e-ba91-66032cdf5b73]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:38 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 Jul 08 10:52:38 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:38 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6" returned: 0 in 1.292s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:38 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6 Jul 08 10:52:38 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:39 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 1073741824" returned: 0 in 1.102s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:39 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 Jul 08 10:52:39 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:39 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757" returned: 0 in 0.955s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:39 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757 Jul 08 10:52:39 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:39 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-383b465d-1afc-40d7-b657-cb231c4a22e6" returned: 0 in 0.913s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-383b465d-1afc-40d7-b657-cb231c4a22e6" released by "delete_volume" :: held 2.274s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:39 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Created reservations ['047cbe6d-5f26-4bbd-8e31-bb1b8680e6e2', 'c14b8ecf-70d4-4f82-b67f-5c33ae773110', 'a136412c-91bd-411e-9e48-949ec3d8f4a0', '502b9e9f-ac99-4d12-806d-60739a684212'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:40 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:40 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:40 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608" returned: 0 in 0.848s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e6e666-8bb8-49ba-849b-9939536eef5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd3def4-b9ed-4886-8754-b64459099608', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223123ab-f407-4982-8131-b15a3fb9bba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:40 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Volume volume-dcd3def4-b9ed-4886-8754-b64459099608 (dcd3def4-b9ed-4886-8754-b64459099608): created successfully Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223123ab-f407-4982-8131-b15a3fb9bba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Flow 'volume_create_manager' (f39c26e3-8a1a-4296-bebe-ff0152e4a901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8401eaf6-ae7e-428f-817f-09adc52c0a5a tempest-GroupSnapshotsV319Test-1511654561 None] Created volume successfully. Jul 08 10:52:40 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-543a6ee4-6bd5-4e26-8078-d227d360a757" returned: 0 in 1.003s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Lock "cinder-quobyte-543a6ee4-6bd5-4e26-8078-d227d360a757" released by "delete_volume" :: held 2.037s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Created reservations ['c21f5b3a-3d41-41c7-b9ff-eb4ef4ab9d76', 'a590d437-f114-436f-bb36-acaeb1a5b2d1', 'adfd6541-b2ba-4e13-b7bc-20ce7647b675', '476b017f-2aee-43b2-a90b-2d1f4d0904be'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:40 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:40 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:41 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] GroupSnapshot a8c5d791-34ce-46e7-8b44-23e97a7e63c5: creating. Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] Group snapshot a8c5d791-34ce-46e7-8b44-23e97a7e63c5: creating. {{(pid=86913) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] Creating offline snapshot 0803a2e5-2033-4e10-bb3c-427ca89af947 of volume dcd3def4-b9ed-4886-8754-b64459099608 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-1118fed6-6673-4926-878f-c695f022c7c8-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Lock "cinder-1118fed6-6673-4926-878f-c695f022c7c8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[85393211-8072-48ac-9f2b-2702d8fda0e0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-quobyte-1118fed6-6673-4926-878f-c695f022c7c8" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-1118fed6-6673-4926-878f-c695f022c7c8" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[119f48df-d4b8-4571-a3be-908083fdabfd]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:41 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.391s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:41 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Deleted volume successfully. Jul 08 10:52:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d9c0e3df-d74e-47fd-9353-58254f048f51 tempest-VolumesGetTest-1284464337 None] Lock "cinder-383b465d-1afc-40d7-b657-cb231c4a22e6-delete_volume" released by "delete_volume" :: held 3.987s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:41 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 Jul 08 10:52:41 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:41 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8 Jul 08 10:52:41 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:42 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.401s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:42 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:42 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Deleted volume successfully. Jul 08 10:52:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6fb6b0a4-f54a-402a-a61b-37ac6ed70f74 tempest-TestStampPattern-920917405 None] Lock "cinder-543a6ee4-6bd5-4e26-8078-d227d360a757-delete_volume" released by "delete_volume" :: held 3.758s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:42 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8" returned: 0 in 1.124s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:42 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8 Jul 08 10:52:42 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:42 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608" returned: 0 in 1.436s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:42 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 1G Jul 08 10:52:42 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:43 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1118fed6-6673-4926-878f-c695f022c7c8" returned: 0 in 0.776s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-1118fed6-6673-4926-878f-c695f022c7c8" released by "delete_volume" :: held 1.981s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Created reservations ['fecd3d66-7842-4532-99ff-9c5a55683c09', 'fd7c31b0-27f8-4bef-9075-552edd3de2a6', 'a3b639df-8650-4e89-bc1d-a5eff16a4c3b', 'e40126f4-a451-45c6-b926-02276aca9d63'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:43 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:43 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-99635ce3-7f33-4438-9663-9c20ba177046-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Lock "cinder-99635ce3-7f33-4438-9663-9c20ba177046-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-quobyte-99635ce3-7f33-4438-9663-9c20ba177046" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-99635ce3-7f33-4438-9663-9c20ba177046" acquired by "delete_volume" :: waited 0.032s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:43 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 1G" returned: 0 in 1.319s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd3def4-b9ed-4886-8754-b64459099608 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:44 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[11de75db-df6f-4c4b-bbc5-c37e147304e7]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:44 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd3def4-b9ed-4886-8754-b64459099608 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 Jul 08 10:52:44 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:44 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 Jul 08 10:52:44 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:44 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.017s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:44 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:44 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Deleted volume successfully. Jul 08 10:52:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-1677087d-1b0b-4504-9a2c-bf7d058fa524 tempest-VolumesGetTest-1284464337 None] Lock "cinder-1118fed6-6673-4926-878f-c695f022c7c8-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:45 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd3def4-b9ed-4886-8754-b64459099608 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947" returned: 0 in 1.039s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:45 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:52:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:45 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 Jul 08 10:52:45 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:45 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046" returned: 0 in 1.280s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:45 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046 Jul 08 10:52:45 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:45 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947" returned: 0 in 0.946s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:46 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.info Jul 08 10:52:46 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:46 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-99635ce3-7f33-4438-9663-9c20ba177046" returned: 0 in 1.041s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-99635ce3-7f33-4438-9663-9c20ba177046" released by "delete_volume" :: held 2.462s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Created reservations ['936317ef-1692-4559-83fe-7c87c13d4419', '968883e4-e9ae-4691-82d0-2b93fdaf1ebc', 'c275f0e8-6fed-45d9-bdb6-51dd25906a16', 'f0023946-7b03-4e63-89f4-c791cb70938f'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:46 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:46 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:46 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.info" returned: 0 in 0.796s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:46 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 10:52:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:46 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.info Jul 08 10:52:46 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:47 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.902s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:47 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Deleted volume successfully. Jul 08 10:52:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e54e485-8610-4ccc-9827-3662fa302c26 tempest-VolumesGetTest-1284464337 None] Lock "cinder-99635ce3-7f33-4438-9663-9c20ba177046-delete_volume" released by "delete_volume" :: held 3.742s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:47 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.info" returned: 0 in 1.113s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.846s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:48 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-301ab80a-d672-44fa-9dc6-50302b7515cd tempest-GroupSnapshotsV319Test-1511654561 None] group_snapshot a8c5d791-34ce-46e7-8b44-23e97a7e63c5: created successfully Jul 08 10:52:48 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:52:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (3fc8347b-9803-44f2-a8dc-2a5579051282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98658a5-d0c9-4bd1-8510-7c6328b57e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98658a5-d0c9-4bd1-8510-7c6328b57e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1861874747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4819d871-20fd-4d50-bb23-910906d7babd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:49Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae48d802-9c08-4167-8fc1-dcc627d1344f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae48d802-9c08-4167-8fc1-dcc627d1344f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a2ef2e-b952-4c4d-8299-1135283cf5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:48 devstack cinder-volume[86913]: DEBUG cinder.image.glance [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Creating Keystone auth plugin from conf {{(pid=86913) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 10:52:49 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] group_snapshot a8c5d791-34ce-46e7-8b44-23e97a7e63c5: deleting Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] group_snapshot a8c5d791-34ce-46e7-8b44-23e97a7e63c5: deleting {{(pid=86913) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Acquiring lock "cinder-quobyte-dcd3def4-b9ed-4886-8754-b64459099608" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Lock "cinder-quobyte-dcd3def4-b9ed-4886-8754-b64459099608" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Acquiring lock "cinder-quobyte-0803a2e5-2033-4e10-bb3c-427ca89af947" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Lock "cinder-quobyte-0803a2e5-2033-4e10-bb3c-427ca89af947" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Deleting offline snapshot 0803a2e5-2033-4e10-bb3c-427ca89af947 of volume dcd3def4-b9ed-4886-8754-b64459099608 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] snapshot_file for this snap is: volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[55127374-7f70-4cea-829c-4fbf1babfad8]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a2ef2e-b952-4c4d-8299-1135283cf5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4819d871-20fd-4d50-bb23-910906d7babd', 'volume_name': 'volume-4819d871-20fd-4d50-bb23-910906d7babd', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a771f49c-62ec-4ff6-97af-2002e29a23ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a771f49c-62ec-4ff6-97af-2002e29a23ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63818bed-8ec5-429e-a3c2-fed62fcb0f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:49 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Volume 4819d871-20fd-4d50-bb23-910906d7babd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4819d871-20fd-4d50-bb23-910906d7babd', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Trying to clone 4819d871-20fd-4d50-bb23-910906d7babd from image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]). {{(pid=86913) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 10:52:49 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 Jul 08 10:52:49 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:49 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 10:52:49 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Image download 20.69 MB at 20.69 MB/s Jul 08 10:52:50 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6f3a90-d2fa-4381-9302-a847bbd715df]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:50 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD Jul 08 10:52:50 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:50 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947" returned: 0 in 1.042s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcd3def4-b9ed-4886-8754-b64459099608(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:52:50 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4718c3b1-e3b5-47a9-9e18-bf977626fca0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:50 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 Jul 08 10:52:50 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:50 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD" returned: 0 in 0.919s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:50 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Temporary image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c is fetched for user 62ea39c9412b452cb132a2b7625992d0. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 10:52:51 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0b332d-eb0e-4673-ba13-0ed5e1bb6d16]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:51 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD Jul 08 10:52:51 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:51 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608" returned: 0 in 1.138s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:51 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 Jul 08 10:52:51 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:52 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD" returned: 0 in 1.042s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1861874747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4819d871-20fd-4d50-bb23-910906d7babd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:49Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Creating volume 4819d871-20fd-4d50-bb23-910906d7babd {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:52:52 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:52 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd 1073741824 Jul 08 10:52:52 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:52 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947" returned: 0 in 1.020s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:52 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947 Jul 08 10:52:52 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:53 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd 1073741824" returned: 0 in 1.216s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:53 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd Jul 08 10:52:53 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:53 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608.0803a2e5-2033-4e10-bb3c-427ca89af947" returned: 0 in 0.884s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Lock "cinder-quobyte-0803a2e5-2033-4e10-bb3c-427ca89af947" released by "_delete_snapshot" :: held 4.268s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Lock "cinder-quobyte-dcd3def4-b9ed-4886-8754-b64459099608" released by "delete_snapshot" :: held 4.300s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:53 devstack cinder-volume[86913]: WARNING cinder.quota [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-655523949 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-655523949, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:52:53 devstack cinder-volume[86913]: WARNING cinder.quota [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-655523949 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-655523949, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] Created reservations ['9eed5fc5-f255-4251-b735-39085fe80592', '9c9db04c-806a-46d6-a8b1-235f7d6482fe', '412a9f7b-e2e6-4556-b674-70e4e8018687', '4a3aeea2-cd82-4e45-bedb-1c7476858d1b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:53 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-28d374ea-4cd2-4a28-87e6-9b760769d362 tempest-GroupSnapshotsV319Test-1511654561 None] group_snapshot a8c5d791-34ce-46e7-8b44-23e97a7e63c5: deleted successfully Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:53 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:53 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:54 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd" returned: 0 in 0.989s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] <== create_volume: return (2276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:52:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:54 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Attempting download of 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c ((None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}])) to volume 4819d871-20fd-4d50-bb23-910906d7babd. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 10:52:54 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fe75b9-7d07-4dcd-8753-8a60fb551a56]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_aiz4bwp6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:54 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_aiz4bwp6 Jul 08 10:52:54 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:54 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.053s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:55 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:52:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:52:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:52:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Acquiring lock "cinder-quobyte-dcd3def4-b9ed-4886-8754-b64459099608" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:52:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Lock "cinder-quobyte-dcd3def4-b9ed-4886-8754-b64459099608" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:52:55 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[055b445b-01f9-4460-9753-f890cb875d7b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:55 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 Jul 08 10:52:55 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:55 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_aiz4bwp6" returned: 0 in 1.217s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_aiz4bwp6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:55 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_aiz4bwp6 Jul 08 10:52:55 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:56 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608" returned: 0 in 1.152s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:56 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608 Jul 08 10:52:56 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:56 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_aiz4bwp6" returned: 1 in 0.888s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_aiz4bwp6' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:52:56 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[37409cf7-4734-4339-872a-8a2b1f0e4a96]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:52:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:56 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD Jul 08 10:52:56 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:57 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dcd3def4-b9ed-4886-8754-b64459099608" returned: 0 in 0.948s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Lock "cinder-quobyte-dcd3def4-b9ed-4886-8754-b64459099608" released by "delete_volume" :: held 2.212s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (a063c2a9-5a2b-4984-a13b-2fece8976856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde63fb4-05b4-48d5-b01f-594344be17ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde63fb4-05b4-48d5-b01f-594344be17ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873437222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3e74b3-de15-463f-bf2d-18ee848d9953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:57Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b551d7e-d321-4900-ad14-cb4ce1399c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b551d7e-d321-4900-ad14-cb4ce1399c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b225f77-7a50-44c1-9aa9-8909a1470377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b225f77-7a50-44c1-9aa9-8909a1470377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d3e74b3-de15-463f-bf2d-18ee848d9953', 'volume_name': 'volume-9d3e74b3-de15-463f-bf2d-18ee848d9953', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8047ad0-4716-475f-8ba8-fbbf867dccf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8047ad0-4716-475f-8ba8-fbbf867dccf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ca818e-5b28-4fe4-a78f-690ffb8190c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:52:57 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume 9d3e74b3-de15-463f-bf2d-18ee848d9953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d3e74b3-de15-463f-bf2d-18ee848d9953', 'volume_size': 1} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873437222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3e74b3-de15-463f-bf2d-18ee848d9953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:52:57Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Creating volume 9d3e74b3-de15-463f-bf2d-18ee848d9953 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:52:57 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Created reservations ['c646184e-f0e7-40ac-8dfc-7d819429285a'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:57 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 1073741824 Jul 08 10:52:57 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:57 devstack cinder-volume[86913]: WARNING cinder.quota [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-655523949 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-655523949, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Created reservations ['e307c760-e7d9-446e-a0c2-0d9236230e01', 'a861e1eb-fdb4-456b-8e88-dab8ffe48bd5', '92088f94-da1e-4000-af63-335df9f01b73', 'e373ccdd-5a14-44af-b46b-0fe726ceb709'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:52:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:58 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:52:58 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:58 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD" returned: 0 in 1.362s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:58 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c was qcow2, converting to raw {{(pid=86913) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 10:52:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:58 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd Jul 08 10:52:58 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:52:59 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.194s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:59 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:52:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-45c70460-6e27-46d6-b6e2-a9e5718c934a tempest-GroupSnapshotsV319Test-1511654561 None] Delete group completed successfully. Jul 08 10:52:59 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 08 10:52:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 1073741824" returned: 0 in 1.571s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:52:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:52:59 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 Jul 08 10:52:59 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Flow 'volume_create_manager' (81cd446e-cbda-471e-9313-688dabe8e505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31368285-569b-42b0-8d75-49ca634726c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31368285-569b-42b0-8d75-49ca634726c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-868077727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e818a827584328b1cdcad6af69007c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:00Z,use_quota=True,user_id='798300a7dbe044f8b6057a8ea7d6a96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1329b3-18b2-4250-be85-7cdba2d6408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1329b3-18b2-4250-be85-7cdba2d6408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddab7cdf-caf1-4713-bdf4-b4b82e2e9206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddab7cdf-caf1-4713-bdf4-b4b82e2e9206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97', 'volume_name': 'volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:00 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184c85ad-8492-4606-bbdb-51d497c26bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184c85ad-8492-4606-bbdb-51d497c26bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba946f4-2158-4c67-8c24-d2ebb6c7243e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:00 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Volume 236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97', 'volume_size': 1} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953" returned: 0 in 1.022s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] <== create_volume: return (2670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.672s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-868077727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e818a827584328b1cdcad6af69007c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:00Z,use_quota=True,user_id='798300a7dbe044f8b6057a8ea7d6a96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Creating volume 236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:00 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:00 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 1073741824 Jul 08 10:53:00 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ca818e-5b28-4fe4-a78f-690ffb8190c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3e74b3-de15-463f-bf2d-18ee848d9953', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3163b9-ef3c-473e-b2b5-2ddb2a1be6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:00 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 (9d3e74b3-de15-463f-bf2d-18ee848d9953): created successfully Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3163b9-ef3c-473e-b2b5-2ddb2a1be6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (a063c2a9-5a2b-4984-a13b-2fece8976856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:00 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5df57f51-ba7c-4a38-baa7-d1f770955f11 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created volume successfully. Jul 08 10:53:00 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd" returned: 0 in 2.896s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_itpt4i2gdevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:53:00 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Converted 112.00 MB image at 38.65 MB/s Jul 08 10:53:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:01 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd 1G Jul 08 10:53:01 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:01 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 1073741824" returned: 0 in 1.094s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:01 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 Jul 08 10:53:01 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:01 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd 1G" returned: 0 in 0.815s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:01 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b850c6-9b17-4b79-874d-ae2bac83043d]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:01 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd Jul 08 10:53:01 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:02 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" returned: 0 in 0.729s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.168s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba946f4-2158-4c67-8c24-d2ebb6c7243e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69dc5671-7792-4a4a-9e1c-71c08932bf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Creating offline snapshot 7c652446-e815-4adf-a511-2ab0028e7905 of volume 9d3e74b3-de15-463f-bf2d-18ee848d9953 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:53:02 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Volume volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 (236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97): created successfully Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69dc5671-7792-4a4a-9e1c-71c08932bf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Flow 'volume_create_manager' (81cd446e-cbda-471e-9313-688dabe8e505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c8b031-c3a7-4d0c-9c88-9b09b75fc4a4]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:02 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9e20ec69-99d0-4ced-a2d0-e6c8df7b5ff5 tempest-SnapshotDependencyTests-1367780590 None] Created volume successfully. Jul 08 10:53:02 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 Jul 08 10:53:02 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:02 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd" returned: 0 in 0.855s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:02 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd Jul 08 10:53:02 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:03 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953" returned: 0 in 0.857s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:03 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 1G Jul 08 10:53:03 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:03 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd" returned: 1 in 0.925s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Downloaded image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c ((None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}])) to volume 4819d871-20fd-4d50-bb23-910906d7babd successfully. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Temporary image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c for user 62ea39c9412b452cb132a2b7625992d0 is deleted. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Marking volume 4819d871-20fd-4d50-bb23-910906d7babd as bootable. {{(pid=86913) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Copying metadata from image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c to 4819d871-20fd-4d50-bb23-910906d7babd. {{(pid=86913) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Creating volume glance metadata for volume 4819d871-20fd-4d50-bb23-910906d7babd backed by image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86913) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63818bed-8ec5-429e-a3c2-fed62fcb0f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4819d871-20fd-4d50-bb23-910906d7babd', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb47a20f-5a89-41f9-be66-30e94ab6abd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:03 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Volume volume-4819d871-20fd-4d50-bb23-910906d7babd (4819d871-20fd-4d50-bb23-910906d7babd): created successfully Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb47a20f-5a89-41f9-be66-30e94ab6abd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (3fc8347b-9803-44f2-a8dc-2a5579051282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:03 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b4018b8c-5b43-48ff-a5a7-319276fbdd0f tempest-VolumesGetTest-1284464337 None] Created volume successfully. Jul 08 10:53:04 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 1G" returned: 0 in 1.130s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:04 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 Jul 08 10:53:04 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:05 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905" returned: 0 in 0.910s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:05 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 is being set with open permissions: ugo+rw Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:05 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 Jul 08 10:53:05 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (fde9f2dc-8ea0-4576-8f58-f8f393f3a3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0586f77-370f-46d0-825a-8e6f9eedfbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0586f77-370f-46d0-825a-8e6f9eedfbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1459775295',display_name='tempest-VolumesGetTest-Volume-1308888968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc29fb9-9e32-40c8-b82e-5b463215c948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:05Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a429623e-5b3b-4940-a211-192d26e24d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a429623e-5b3b-4940-a211-192d26e24d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca801f6a-5e3d-4853-b7e6-41cb5443f019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca801f6a-5e3d-4853-b7e6-41cb5443f019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdc29fb9-9e32-40c8-b82e-5b463215c948', 'volume_name': 'volume-cdc29fb9-9e32-40c8-b82e-5b463215c948', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1c7e91-6881-41b5-9e89-712a20b209cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1c7e91-6881-41b5-9e89-712a20b209cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b6a23f-c6de-4252-a783-5c32e07f8aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:05 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Volume cdc29fb9-9e32-40c8-b82e-5b463215c948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdc29fb9-9e32-40c8-b82e-5b463215c948', 'volume_size': 1} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:05 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905" returned: 0 in 0.723s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:05 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.info Jul 08 10:53:05 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:06 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.info" returned: 0 in 0.716s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:06 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.info is being set with open permissions: ugo+rw Jul 08 10:53:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:06 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.info Jul 08 10:53:06 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:07 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.info" returned: 0 in 0.727s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.191s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.600s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] Creating offline snapshot 878dcce7-ae54-481f-b5c3-44465f1369b8 of volume 236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:53:07 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0a71ccbc-698c-4525-84bd-87e2bce83ec6 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Create snapshot completed successfully Jul 08 10:53:07 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cf7a97-78e6-4887-b915-e84922549862]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:07 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 Jul 08 10:53:07 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:08 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" returned: 0 in 0.851s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:08 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 1G Jul 08 10:53:08 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:08 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (2374e80a-9716-4474-994d-06c8e0ed3d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f32ff6-c131-45d8-be81-595c8cc257a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f32ff6-c131-45d8-be81-595c8cc257a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751162558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ab729d-1a57-4606-b582-adf128b5ea62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:09Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176e1d73-ab3c-4123-8127-5deb1d6d4327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176e1d73-ab3c-4123-8127-5deb1d6d4327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c9c8d8-e3ac-46ab-b9d5-40ea4953d4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c9c8d8-e3ac-46ab-b9d5-40ea4953d4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ab729d-1a57-4606-b582-adf128b5ea62', 'volume_name': 'volume-d7ab729d-1a57-4606-b582-adf128b5ea62', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5959a5e8-b3fd-4ffe-85b6-7cadf54aaa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5959a5e8-b3fd-4ffe-85b6-7cadf54aaa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9772a5-ef11-4f3f-b152-1d464ddbf0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:09 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume d7ab729d-1a57-4606-b582-adf128b5ea62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ab729d-1a57-4606-b582-adf128b5ea62', 'volume_size': 1} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:09 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 1G" returned: 0 in 1.003s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:09 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 Jul 08 10:53:09 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (143e9970-5105-4373-a87f-8b3bf9701c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4f4066-085a-4851-b15c-3f0276e92fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4f4066-085a-4851-b15c-3f0276e92fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478463387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3284581e-495f-43c1-91d0-b749d2cf7843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:09Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b28d78-4e81-4b8d-9e95-bd1b495dc81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b28d78-4e81-4b8d-9e95-bd1b495dc81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6d976b-19d9-4114-a384-f37e886bf5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6d976b-19d9-4114-a384-f37e886bf5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3284581e-495f-43c1-91d0-b749d2cf7843', 'volume_name': 'volume-3284581e-495f-43c1-91d0-b749d2cf7843', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f756d2-ded6-473f-88c3-bda5c5d91c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f756d2-ded6-473f-88c3-bda5c5d91c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b597e9-bec1-434e-8eec-2658a5321014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:09 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume 3284581e-495f-43c1-91d0-b749d2cf7843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3284581e-495f-43c1-91d0-b749d2cf7843', 'volume_size': 1} Jul 08 10:53:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (eb8dfc97-3c86-4440-bd0a-4b94dc39ed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60df26b-13e1-4a35-9a65-e552551a5ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60df26b-13e1-4a35-9a65-e552551a5ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314727131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a26366-6fc4-46b4-ab03-5bf924764aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:10Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8450153-80c9-4ac5-af5c-619b1510b0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8450153-80c9-4ac5-af5c-619b1510b0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8eaa82-cc17-489a-a9da-57f38464e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8eaa82-cc17-489a-a9da-57f38464e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49a26366-6fc4-46b4-ab03-5bf924764aa8', 'volume_name': 'volume-49a26366-6fc4-46b4-ab03-5bf924764aa8', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f154986c-a052-4ab1-a01f-ca49440e6657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f154986c-a052-4ab1-a01f-ca49440e6657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217b411c-eb9b-4238-aad7-2d72036baa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume 49a26366-6fc4-46b4-ab03-5bf924764aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49a26366-6fc4-46b4-ab03-5bf924764aa8', 'volume_size': 1} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:10 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8" returned: 0 in 0.993s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:10 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 is being set with open permissions: ugo+rw Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:10 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 Jul 08 10:53:10 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (a62d2000-45cd-47d9-be38-372615137fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4a787a-22fa-4fab-979d-6b411028bb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4a787a-22fa-4fab-979d-6b411028bb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58519823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec18e92-ebbf-4a9b-be95-23f8e97fe79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:10Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7d95ce-1286-4aa4-aa4f-f9ebf817b97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7d95ce-1286-4aa4-aa4f-f9ebf817b97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e88a5a-204f-4a72-8b4f-aacd3e259553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e88a5a-204f-4a72-8b4f-aacd3e259553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec18e92-ebbf-4a9b-be95-23f8e97fe79e', 'volume_name': 'volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905962fc-df80-4cf9-aebf-5551c2e5fe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905962fc-df80-4cf9-aebf-5551c2e5fe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a7472e-6926-43ed-be47-97c2a7041088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume 2ec18e92-ebbf-4a9b-be95-23f8e97fe79e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e', 'volume_size': 1} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (7375e64c-f249-449d-9257-51219e37e9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afaf1bd-17e3-4a04-a42a-414e535d1a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afaf1bd-17e3-4a04-a42a-414e535d1a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799719718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6c9bb3-2eef-4c06-8b70-0c8a6574594d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:11Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d64f5a5-a8cd-41f2-8e37-5540d5fe4b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d64f5a5-a8cd-41f2-8e37-5540d5fe4b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7e5bc4-ec12-48fb-841e-16e09a981f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7e5bc4-ec12-48fb-841e-16e09a981f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6c9bb3-2eef-4c06-8b70-0c8a6574594d', 'volume_name': 'volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d8d2e1-2771-4a17-af4b-c39fd48dcc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d8d2e1-2771-4a17-af4b-c39fd48dcc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd72125-efa5-4393-819f-83e81018c24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:10 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume 2d6c9bb3-2eef-4c06-8b70-0c8a6574594d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d', 'volume_size': 1} Jul 08 10:53:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:11 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8" returned: 0 in 0.814s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:11 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.info Jul 08 10:53:11 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:11 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.info" returned: 0 in 0.678s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:11 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.info is being set with open permissions: ugo+rw Jul 08 10:53:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:11 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.info Jul 08 10:53:11 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:12 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.info" returned: 0 in 0.673s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.119s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.200s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1459775295',display_name='tempest-VolumesGetTest-Volume-1308888968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc29fb9-9e32-40c8-b82e-5b463215c948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6baddb7e6340b4827b31b4346676a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:05Z,use_quota=True,user_id='62ea39c9412b452cb132a2b7625992d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Creating volume cdc29fb9-9e32-40c8-b82e-5b463215c948 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:12 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:12 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948 1073741824 Jul 08 10:53:12 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:12 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3ee93fac-f904-41a0-9f2e-d2824b251478 tempest-SnapshotDependencyTests-1367780590 None] Create snapshot completed successfully Jul 08 10:53:13 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948 1073741824" returned: 0 in 1.013s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:13 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948 Jul 08 10:53:13 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:13 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Flow 'volume_create_manager' (2d9dde7a-c27e-41e8-b39a-248539379cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adff4cb6-c636-4956-bc66-e4d1604c735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adff4cb6-c636-4956-bc66-e4d1604c735d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564b59f9-deae-465c-8a64-9402aa66e79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e818a827584328b1cdcad6af69007c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=878dcce7-ae54-481f-b5c3-44465f1369b8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:14Z,use_quota=True,user_id='798300a7dbe044f8b6057a8ea7d6a96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fb2ba5-c19c-4998-a8bf-d84f4c6456d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fb2ba5-c19c-4998-a8bf-d84f4c6456d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bad8b7-f021-4e01-a0de-fea02cfd6843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bad8b7-f021-4e01-a0de-fea02cfd6843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '564b59f9-deae-465c-8a64-9402aa66e79d', 'volume_name': 'volume-564b59f9-deae-465c-8a64-9402aa66e79d', 'volume_size': 1, 'snapshot_id': '878dcce7-ae54-481f-b5c3-44465f1369b8'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef2893e-5534-4c36-b69d-f41e0576ca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef2893e-5534-4c36-b69d-f41e0576ca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29255a20-29a8-43db-88fa-634235dbe7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:14 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Volume 564b59f9-deae-465c-8a64-9402aa66e79d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-564b59f9-deae-465c-8a64-9402aa66e79d', 'volume_size': 1, 'snapshot_id': '878dcce7-ae54-481f-b5c3-44465f1369b8'} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:14 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948" returned: 0 in 0.863s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.388s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751162558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ab729d-1a57-4606-b582-adf128b5ea62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:09Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Creating volume d7ab729d-1a57-4606-b582-adf128b5ea62 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:14 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b6a23f-c6de-4252-a783-5c32e07f8aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc29fb9-9e32-40c8-b82e-5b463215c948', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:14 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62 1073741824 Jul 08 10:53:14 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7b3550-3077-440f-be14-d386c5425327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:14 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Volume volume-cdc29fb9-9e32-40c8-b82e-5b463215c948 (cdc29fb9-9e32-40c8-b82e-5b463215c948): created successfully Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7b3550-3077-440f-be14-d386c5425327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Flow 'volume_create_manager' (fde9f2dc-8ea0-4576-8f58-f8f393f3a3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:14 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c765a13f-7ae5-4e8b-8b00-256be32d8d0b tempest-VolumesGetTest-1284464337 None] Created volume successfully. Jul 08 10:53:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-cdc29fb9-9e32-40c8-b82e-5b463215c948-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Lock "cinder-cdc29fb9-9e32-40c8-b82e-5b463215c948-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-quobyte-cdc29fb9-9e32-40c8-b82e-5b463215c948" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-cdc29fb9-9e32-40c8-b82e-5b463215c948" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:15 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[01daa1eb-24fa-4c58-a20a-b5fcba061b50]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:15 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948 Jul 08 10:53:15 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:15 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62 1073741824" returned: 0 in 0.995s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:15 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62 Jul 08 10:53:15 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:16 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948" returned: 0 in 0.837s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:16 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948 Jul 08 10:53:16 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:16 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62" returned: 0 in 0.747s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.702s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478463387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3284581e-495f-43c1-91d0-b749d2cf7843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:09Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Creating volume 3284581e-495f-43c1-91d0-b749d2cf7843 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:16 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9772a5-ef11-4f3f-b152-1d464ddbf0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ab729d-1a57-4606-b582-adf128b5ea62', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:16 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843 1073741824 Jul 08 10:53:16 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ed29dc-8351-45f4-a8d3-9f30ab94fbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:16 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume volume-d7ab729d-1a57-4606-b582-adf128b5ea62 (d7ab729d-1a57-4606-b582-adf128b5ea62): created successfully Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ed29dc-8351-45f4-a8d3-9f30ab94fbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (2374e80a-9716-4474-994d-06c8e0ed3d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:16 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-7bd898ba-2bc1-44b4-b0b3-aabd94ddb613 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created volume successfully. Jul 08 10:53:16 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cdc29fb9-9e32-40c8-b82e-5b463215c948" returned: 0 in 0.714s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-cdc29fb9-9e32-40c8-b82e-5b463215c948" released by "delete_volume" :: held 1.605s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:16 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Created reservations ['9a1e5870-190a-4389-b9a7-1d489ce21940', '3f71de5f-4dda-42f3-afb5-428ad97869e7', '17e309a3-86e4-4d2f-8c33-1e580997b2e7', '91234a23-cb71-467c-a80d-1dae390b64c1'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:17 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:17 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:17 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843 1073741824" returned: 0 in 1.050s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:17 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843 Jul 08 10:53:17 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-4819d871-20fd-4d50-bb23-910906d7babd-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Lock "cinder-4819d871-20fd-4d50-bb23-910906d7babd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Acquiring lock "cinder-quobyte-4819d871-20fd-4d50-bb23-910906d7babd" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-4819d871-20fd-4d50-bb23-910906d7babd" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[031a29e9-1ddf-4185-b971-bbc80f7642cb]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:17 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.864s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:17 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd Jul 08 10:53:17 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:17 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Deleted volume successfully. Jul 08 10:53:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-50b22668-a18f-497e-8a42-8d7df219e351 tempest-VolumesGetTest-1284464337 None] Lock "cinder-cdc29fb9-9e32-40c8-b82e-5b463215c948-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:18 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843" returned: 0 in 0.821s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.098s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314727131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a26366-6fc4-46b4-ab03-5bf924764aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:10Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Creating volume 49a26366-6fc4-46b4-ab03-5bf924764aa8 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:18 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:18 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8 1073741824 Jul 08 10:53:18 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b597e9-bec1-434e-8eec-2658a5321014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3284581e-495f-43c1-91d0-b749d2cf7843', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b074f607-ca95-4fc4-a6f1-de9a031b4a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:18 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume volume-3284581e-495f-43c1-91d0-b749d2cf7843 (3284581e-495f-43c1-91d0-b749d2cf7843): created successfully Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b074f607-ca95-4fc4-a6f1-de9a031b4a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (143e9970-5105-4373-a87f-8b3bf9701c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-bd1f3878-7fd3-4637-a11a-7cdc1ba46b02 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created volume successfully. Jul 08 10:53:18 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd" returned: 0 in 0.986s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:18 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd Jul 08 10:53:18 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:19 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8 1073741824" returned: 0 in 1.226s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:19 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8 Jul 08 10:53:19 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:19 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd" returned: 1 in 0.923s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:53:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:19 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd Jul 08 10:53:19 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:20 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8" returned: 0 in 0.800s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.722s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58519823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec18e92-ebbf-4a9b-be95-23f8e97fe79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:10Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Creating volume 2ec18e92-ebbf-4a9b-be95-23f8e97fe79e {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:20 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:20 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e 1073741824 Jul 08 10:53:20 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217b411c-eb9b-4238-aad7-2d72036baa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49a26366-6fc4-46b4-ab03-5bf924764aa8', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68587a0f-48d1-43a4-ac0d-2330b49c2ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:20 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume volume-49a26366-6fc4-46b4-ab03-5bf924764aa8 (49a26366-6fc4-46b4-ab03-5bf924764aa8): created successfully Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68587a0f-48d1-43a4-ac0d-2330b49c2ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (eb8dfc97-3c86-4440-bd0a-4b94dc39ed32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-35ce7d50-e9ae-43fe-bcc3-f0e8dba451c9 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created volume successfully. Jul 08 10:53:20 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4819d871-20fd-4d50-bb23-910906d7babd" returned: 0 in 0.745s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Lock "cinder-quobyte-4819d871-20fd-4d50-bb23-910906d7babd" released by "delete_volume" :: held 2.740s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Created reservations ['2433de2f-b6d6-4b99-9c5b-a9129eb6c2fa', '1660357b-0149-461b-b8cb-952f2e8f74c4', '1fca9c88-3403-4d4c-a28a-88fefe990bc0', '711cb727-fa21-4abe-86ac-f171bb6d1019'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:20 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:20 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:21 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.835s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:21 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:21 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Deleted volume successfully. Jul 08 10:53:21 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e 1073741824" returned: 0 in 1.167s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e94d9820-5105-4193-962f-2d5d6d5e6421 tempest-VolumesGetTest-1284464337 None] Lock "cinder-4819d871-20fd-4d50-bb23-910906d7babd-delete_volume" released by "delete_volume" :: held 3.903s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:21 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e Jul 08 10:53:21 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:22 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e" returned: 0 in 0.737s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.302s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799719718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6c9bb3-2eef-4c06-8b70-0c8a6574594d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b38fb3cf3b47b58ff88c5659d6cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:11Z,use_quota=True,user_id='dc0043dec3774497af3abab01dbe3386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Creating volume 2d6c9bb3-2eef-4c06-8b70-0c8a6574594d {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:22 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a7472e-6926-43ed-be47-97c2a7041088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b40ebb-bf90-4abf-a290-1ba8c6423d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:22 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d 1073741824 Jul 08 10:53:22 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:22 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e (2ec18e92-ebbf-4a9b-be95-23f8e97fe79e): created successfully Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b40ebb-bf90-4abf-a290-1ba8c6423d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (a62d2000-45cd-47d9-be38-372615137fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:22 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4273d23d-faa2-454d-b413-9c26e54fc365 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created volume successfully. Jul 08 10:53:23 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d 1073741824" returned: 0 in 0.984s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:23 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d Jul 08 10:53:23 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:23 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d" returned: 0 in 0.686s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.898s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "cinder-quobyte-878dcce7-ae54-481f-b5c3-44465f1369b8-564b59f9-deae-465c-8a64-9402aa66e79d" by "_create_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd72125-efa5-4393-819f-83e81018c24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82020d76-693a-44c8-8303-dd7a40c98fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-878dcce7-ae54-481f-b5c3-44465f1369b8-564b59f9-deae-465c-8a64-9402aa66e79d" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Creating volume 564b59f9-deae-465c-8a64-9402aa66e79d from snapshot 878dcce7-ae54-481f-b5c3-44465f1369b8 {{(pid=86913) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "cinder-quobyte-564b59f9-deae-465c-8a64-9402aa66e79d" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:24 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Volume volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d (2d6c9bb3-2eef-4c06-8b70-0c8a6574594d): created successfully Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82020d76-693a-44c8-8303-dd7a40c98fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Flow 'volume_create_manager' (7375e64c-f249-449d-9257-51219e37e9d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-564b59f9-deae-465c-8a64-9402aa66e79d" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] snapshot: 878dcce7-ae54-481f-b5c3-44465f1369b8, volume: 564b59f9-deae-465c-8a64-9402aa66e79d, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 10:53:24 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d41576c2-51fe-4027-b49a-cebc27b0cd97 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created volume successfully. Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a7ba9b-de7b-4e31-8cde-0b41038efa41]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:24 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 Jul 08 10:53:24 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=115,cinder:SELECT=102,cinder:INSERT=33,cinder:DELETE=8 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Flow 'volume_create_manager' (4e902ae3-2e5e-4439-84a1-f67f9661d16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8bc0d4e-677b-43ee-81ab-938c950678ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8bc0d4e-677b-43ee-81ab-938c950678ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-904849779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5af349-41a5-4a14-bb7f-cc0137f54e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3ea26ad654b9083408e1699d29280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:25Z,use_quota=True,user_id='7d4995f88a0e401e8401d5e4f3ce3d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569b5bed-b67d-4639-945c-645c561ec0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569b5bed-b67d-4639-945c-645c561ec0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854a5c03-7728-4b24-9d82-5ddc47d35c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854a5c03-7728-4b24-9d82-5ddc47d35c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b5af349-41a5-4a14-bb7f-cc0137f54e60', 'volume_name': 'volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee67bcb-65af-4bac-82c9-06534957970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee67bcb-65af-4bac-82c9-06534957970b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbab067-fd5b-4a6c-935d-9f2cd63f3abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:24 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Volume 4b5af349-41a5-4a14-bb7f-cc0137f54e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60', 'volume_size': 1} Jul 08 10:53:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:25 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8" returned: 0 in 0.945s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67b5f1d-3327-4e84-a9c0-6f569836d4c4]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:25 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 Jul 08 10:53:25 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-quobyte-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bbc8e6-62d4-40b0-9e50-a0e1cd7cbdcb]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:25 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d Jul 08 10:53:25 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Flow 'volume_create_manager' (2abc84df-ae27-448d-b0f5-11c601a50e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266db9e5-4497-46ea-8dbd-7ea0ac794ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266db9e5-4497-46ea-8dbd-7ea0ac794ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-582262663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e37848-01e3-450a-802e-d009a5f8b3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc3984ddbff497192fc891e1e9ac3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:26Z,use_quota=True,user_id='aa9fd561af1c4437bad2604267f6487a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4841b2a-024e-453e-9ad6-3c1757dd9d54),volume_type_id=f4841b2a-024e-453e-9ad6-3c1757dd9d54)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b997db-6ee2-47f3-a27c-4bee35dd7ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b997db-6ee2-47f3-a27c-4bee35dd7ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d755df64-4f6a-42ca-bbeb-a6d3fb4b4b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d755df64-4f6a-42ca-bbeb-a6d3fb4b4b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e37848-01e3-450a-802e-d009a5f8b3d6', 'volume_name': 'volume-54e37848-01e3-450a-802e-d009a5f8b3d6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2b1d12-c441-4234-9c9f-23c64dc55095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2b1d12-c441-4234-9c9f-23c64dc55095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847655bc-27f5-4ef0-b1f2-eeb5a591097d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:25 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Volume 54e37848-01e3-450a-802e-d009a5f8b3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e37848-01e3-450a-802e-d009a5f8b3d6', 'volume_size': 1} Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:25 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" returned: 0 in 0.867s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:26 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 10:53:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:26 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d Jul 08 10:53:26 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:26 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d" returned: 0 in 0.803s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:26 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d Jul 08 10:53:26 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:26 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d" returned: 0 in 0.708s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d" released by "delete_volume" :: held 1.577s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:26 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created reservations ['3a0d59f3-4a62-4231-be6b-c3ad6f66ac2d', '2ca66d78-c23d-498d-ab13-da8a0f74c266', '1a59d995-332b-4fdf-8e1c-3ab27c6a7696', '3b27a130-760c-4ee3-b6e0-be5857122687'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:27 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:27 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-quobyte-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e" acquired by "delete_volume" :: waited 0.035s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[50313ab3-9437-42df-8f49-87a16b0de14b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:28 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e Jul 08 10:53:28 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:29 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 2.181s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:29 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Deleted volume successfully. Jul 08 10:53:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5b7003c4-edf0-4464-9c26-66ecf41ece99 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-2d6c9bb3-2eef-4c06-8b70-0c8a6574594d-delete_volume" released by "delete_volume" :: held 4.170s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:29 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e" returned: 0 in 2.044s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:30 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e Jul 08 10:53:30 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:31 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e" returned: 0 in 1.541s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e" released by "delete_volume" :: held 3.698s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:31 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=104,cinder:INSERT=35,cinder:UPDATE=124,cinder:DELETE=12 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d" returned: 0 in 5.537s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec94f7e5-b979-45f5-8cd5-69cbef0ef43b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created reservations ['e95f69fc-c6e1-47d0-95d0-70ab3a5d868a', 'ba922b36-c5c1-432e-9a7d-4f12eaadb8a6', 'a79ba17f-ef43-4506-8fc3-25088181644c', '0e9ec0b0-e101-4d35-894a-6f3802b54aba'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:31 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 Jul 08 10:53:31 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:31 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:31 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:32 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.650s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:32 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Deleted volume successfully. Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-83bddcf0-0a58-4abf-bb69-31a217e41daa tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-2ec18e92-ebbf-4a9b-be95-23f8e97fe79e-delete_volume" released by "delete_volume" :: held 4.654s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-49a26366-6fc4-46b4-ab03-5bf924764aa8-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-49a26366-6fc4-46b4-ab03-5bf924764aa8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-quobyte-49a26366-6fc4-46b4-ab03-5bf924764aa8" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-49a26366-6fc4-46b4-ab03-5bf924764aa8" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0054cfb4-0038-4215-a0f3-2c83da00fa77]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:32 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" returned: 0 in 0.996s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:53:32 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Converted 1024.00 MB image at 184.89 MB/s Jul 08 10:53:32 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d is being set with open permissions: ugo+rw Jul 08 10:53:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:32 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d Jul 08 10:53:32 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:32 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8 Jul 08 10:53:32 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:33 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d" returned: 0 in 0.708s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-564b59f9-deae-465c-8a64-9402aa66e79d" released by "_copy_volume_from_snapshot" :: held 9.192s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:33 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8" returned: 0 in 0.754s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-878dcce7-ae54-481f-b5c3-44465f1369b8-564b59f9-deae-465c-8a64-9402aa66e79d" released by "_create_volume_from_snapshot" :: held 9.253s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.297s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.387s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-904849779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5af349-41a5-4a14-bb7f-cc0137f54e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3ea26ad654b9083408e1699d29280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:25Z,use_quota=True,user_id='7d4995f88a0e401e8401d5e4f3ce3d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Creating volume 4b5af349-41a5-4a14-bb7f-cc0137f54e60 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:33 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8 Jul 08 10:53:33 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:33 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:33 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60 1073741824 Jul 08 10:53:33 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29255a20-29a8-43db-88fa-634235dbe7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564b59f9-deae-465c-8a64-9402aa66e79d', 'volume_size': 1, 'snapshot_id': '878dcce7-ae54-481f-b5c3-44465f1369b8'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731ba5c3-70d8-489e-8c19-a39e8fc19fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:33 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Volume volume-564b59f9-deae-465c-8a64-9402aa66e79d (564b59f9-deae-465c-8a64-9402aa66e79d): created successfully Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731ba5c3-70d8-489e-8c19-a39e8fc19fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Flow 'volume_create_manager' (2d9dde7a-c27e-41e8-b39a-248539379cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:33 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-27bba644-4281-4a7a-bad5-c8665ab9eb56 tempest-SnapshotDependencyTests-1367780590 None] Created volume successfully. Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "cinder-878dcce7-ae54-481f-b5c3-44465f1369b8-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-878dcce7-ae54-481f-b5c3-44465f1369b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "cinder-quobyte-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "cinder-quobyte-878dcce7-ae54-481f-b5c3-44465f1369b8" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-878dcce7-ae54-481f-b5c3-44465f1369b8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Deleting offline snapshot 878dcce7-ae54-481f-b5c3-44465f1369b8 of volume 236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] snapshot_file for this snap is: volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ca0a76-3a54-46df-96cc-766454e38e84]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:33 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 Jul 08 10:53:33 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:34 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-49a26366-6fc4-46b4-ab03-5bf924764aa8" returned: 0 in 0.761s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-49a26366-6fc4-46b4-ab03-5bf924764aa8" released by "delete_volume" :: held 1.566s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created reservations ['d79f5d7a-e872-4ae9-aed8-3bcf3e8195b4', 'c4ba5758-9e55-413a-8938-db5fcd632306', '6bebe69e-58f4-4fdc-9066-81cdcbe356cf', 'a3cf67f1-becd-4b1e-ba27-cfb4e7b4982f'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:34 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60 1073741824" returned: 0 in 0.847s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:34 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:34 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:34 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60 Jul 08 10:53:34 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-3284581e-495f-43c1-91d0-b749d2cf7843-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-3284581e-495f-43c1-91d0-b749d2cf7843-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-quobyte-3284581e-495f-43c1-91d0-b749d2cf7843" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-3284581e-495f-43c1-91d0-b749d2cf7843" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:34 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8" returned: 0 in 0.996s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b0148e-bb0c-4125-a2e0-53b5419602da]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaacaa1-3fb3-44ef-a4b8-71e6578529c4]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:34 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.723s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:34 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Deleted volume successfully. Jul 08 10:53:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0314a7bf-946e-4e5d-a934-09e9d8b0fbae tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-49a26366-6fc4-46b4-ab03-5bf924764aa8-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:35 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 Jul 08 10:53:35 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:35 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843 Jul 08 10:53:35 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:35 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60" returned: 0 in 0.837s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.268s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-582262663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e37848-01e3-450a-802e-d009a5f8b3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc3984ddbff497192fc891e1e9ac3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:26Z,use_quota=True,user_id='aa9fd561af1c4437bad2604267f6487a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4841b2a-024e-453e-9ad6-3c1757dd9d54),volume_type_id=f4841b2a-024e-453e-9ad6-3c1757dd9d54)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Creating volume 54e37848-01e3-450a-802e-d009a5f8b3d6 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:35 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:35 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6 1073741824 Jul 08 10:53:35 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbab067-fd5b-4a6c-935d-9f2cd63f3abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faab414-5cff-4089-8e92-475bcd5c1557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:35 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Volume volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60 (4b5af349-41a5-4a14-bb7f-cc0137f54e60): created successfully Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faab414-5cff-4089-8e92-475bcd5c1557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Flow 'volume_create_manager' (4e902ae3-2e5e-4439-84a1-f67f9661d16c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:35 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6419d3a8-4d84-4f88-81b5-29173b30b8f6 tempest-VolumesNegativeTest-1824605826 None] Created volume successfully. Jul 08 10:53:35 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" returned: 0 in 0.841s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:35 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 Jul 08 10:53:35 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:35 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843" returned: 0 in 1.002s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:35 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843 Jul 08 10:53:35 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:36 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6 1073741824" returned: 0 in 1.094s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:36 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6 Jul 08 10:53:36 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:36 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8" returned: 0 in 0.961s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:36 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3284581e-495f-43c1-91d0-b749d2cf7843" returned: 0 in 0.835s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:36 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8 Jul 08 10:53:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-3284581e-495f-43c1-91d0-b749d2cf7843" released by "delete_volume" :: held 1.922s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:36 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:36 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created reservations ['ad960306-6e67-4ce7-b13d-8bb20797fe1b', '263b285d-fd14-414e-88d3-05b7009fbe9c', 'b944eb8d-efa4-43e1-898b-0a0823b80eed', 'ee4c8770-a00c-4609-be44-b03f55ca286e'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-d7ab729d-1a57-4606-b582-adf128b5ea62-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:37 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:37 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-d7ab729d-1a57-4606-b582-adf128b5ea62-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:37 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6" returned: 0 in 0.923s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-quobyte-d7ab729d-1a57-4606-b582-adf128b5ea62" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847655bc-27f5-4ef0-b1f2-eeb5a591097d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e37848-01e3-450a-802e-d009a5f8b3d6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f347f01d-7975-463b-bd00-b3649dec38df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-d7ab729d-1a57-4606-b582-adf128b5ea62" acquired by "delete_volume" :: waited 0.051s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:37 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Volume volume-54e37848-01e3-450a-802e-d009a5f8b3d6 (54e37848-01e3-450a-802e-d009a5f8b3d6): created successfully Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f347f01d-7975-463b-bd00-b3649dec38df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Flow 'volume_create_manager' (2abc84df-ae27-448d-b0f5-11c601a50e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6834c518-a595-49ef-8d09-3caef114b1a7]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:37 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b991e872-da7c-491f-9f11-1babd43ab639 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Created volume successfully. Jul 08 10:53:37 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62 Jul 08 10:53:37 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:37 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97.878dcce7-ae54-481f-b5c3-44465f1369b8" returned: 0 in 0.889s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-878dcce7-ae54-481f-b5c3-44465f1369b8" released by "_delete_snapshot" :: held 3.821s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" released by "delete_snapshot" :: held 3.849s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Created reservations ['737dbd69-d920-4eae-ae3d-4002d57af4e0', '663f4d6d-4511-4dcd-8775-d3066506d26c', '9579e785-c8ca-4ff5-83b1-b275971d0b02', 'f9bde6dc-4575-407f-896c-535992fa0a98'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:37 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Delete snapshot completed successfully. Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ccb09d29-6502-4a18-83c6-d40592448cbf tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-878dcce7-ae54-481f-b5c3-44465f1369b8-delete_snapshot" released by "delete_snapshot" :: held 4.014s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:37 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.869s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:37 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Deleted volume successfully. Jul 08 10:53:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-497fc6da-5e17-484d-8539-50f024c6ba28 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-3284581e-495f-43c1-91d0-b749d2cf7843-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "cinder-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "cinder-quobyte-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:38 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62" returned: 0 in 0.979s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" acquired by "delete_volume" :: waited 0.053s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:38 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62 Jul 08 10:53:38 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[912ebc4f-70fa-4e61-9f8c-a470dd403c09]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:38 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 Jul 08 10:53:38 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c1fe7657-e1cc-4e63-801a-813830758058 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c1fe7657-e1cc-4e63-801a-813830758058 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c1fe7657-e1cc-4e63-801a-813830758058 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c1fe7657-e1cc-4e63-801a-813830758058 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c1fe7657-e1cc-4e63-801a-813830758058 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c1fe7657-e1cc-4e63-801a-813830758058 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:38 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:38 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:39 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d7ab729d-1a57-4606-b582-adf128b5ea62" returned: 0 in 0.798s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-d7ab729d-1a57-4606-b582-adf128b5ea62" released by "delete_volume" :: held 1.856s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created reservations ['c95a7424-021c-4ae0-b560-b0a371fa0ea5', '2a8ca737-1630-49ca-be89-8a25996e1d42', '4d93b7eb-c26b-4794-b097-df73f048ae38', 'e8bf4463-4536-4fa2-aaa8-06dc5bf0a925'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:39 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:39 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:39 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" returned: 0 in 0.899s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:39 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c1fe7657-e1cc-4e63-801a-813830758058 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.730s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-c1fe7657-e1cc-4e63-801a-813830758058 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c1fe7657-e1cc-4e63-801a-813830758058 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Retype volume completed successfully. Jul 08 10:53:39 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97 Jul 08 10:53:39 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-7c652446-e815-4adf-a511-2ab0028e7905-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-7c652446-e815-4adf-a511-2ab0028e7905-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-quobyte-9d3e74b3-de15-463f-bf2d-18ee848d9953" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-9d3e74b3-de15-463f-bf2d-18ee848d9953" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-quobyte-7c652446-e815-4adf-a511-2ab0028e7905" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-7c652446-e815-4adf-a511-2ab0028e7905" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Deleting offline snapshot 7c652446-e815-4adf-a511-2ab0028e7905 of volume 9d3e74b3-de15-463f-bf2d-18ee848d9953 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] snapshot_file for this snap is: volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac742635-7dd5-4314-bb07-9a3a7f391ca7]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:39 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 Jul 08 10:53:39 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Acquiring lock "cinder-54e37848-01e3-450a-802e-d009a5f8b3d6-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "cinder-54e37848-01e3-450a-802e-d009a5f8b3d6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:39 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.789s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:39 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Deleted volume successfully. Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-551b044b-24d0-480c-9dba-1cda20e278fb tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-d7ab729d-1a57-4606-b582-adf128b5ea62-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Acquiring lock "cinder-quobyte-54e37848-01e3-450a-802e-d009a5f8b3d6" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "cinder-quobyte-54e37848-01e3-450a-802e-d009a5f8b3d6" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:40 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" returned: 0 in 0.831s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fa2067-dbc7-430e-a83d-43058bfef36f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97" released by "delete_volume" :: held 1.832s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Created reservations ['6c4aa788-87bd-4731-b484-cbc34f3c0f5b', '5d0d3322-6127-4f20-9827-d1691a3f2b52', 'a878bb39-16cb-4895-9c05-d666878fdde5', 'c43294d5-364e-48bb-961d-639a0f20c8d9'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:40 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6 Jul 08 10:53:40 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:40 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:40 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "cinder-564b59f9-deae-465c-8a64-9402aa66e79d-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-564b59f9-deae-465c-8a64-9402aa66e79d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "cinder-quobyte-564b59f9-deae-465c-8a64-9402aa66e79d" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-564b59f9-deae-465c-8a64-9402aa66e79d" acquired by "delete_volume" :: waited 0.036s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d44d35-e752-4ac2-90c4-276bf075015b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:40 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905" returned: 0 in 1.081s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d3e74b3-de15-463f-bf2d-18ee848d9953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b9ed32-db03-4fdf-bd4f-bf1161224437]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:40 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d Jul 08 10:53:40 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:40 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 Jul 08 10:53:40 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:41 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:41 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6" returned: 0 in 0.975s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.814s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:41 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:41 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Deleted volume successfully. Jul 08 10:53:41 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6 Jul 08 10:53:41 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3f51e776-7a71-4673-9c38-5edebf8cfccb tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-236e94d8-fdd7-4b29-8c1f-2b8e69c2aa97-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:41 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d" returned: 0 in 1.185s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:41 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d Jul 08 10:53:41 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:41 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953" returned: 0 in 1.205s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:41 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 Jul 08 10:53:41 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:42 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-54e37848-01e3-450a-802e-d009a5f8b3d6" returned: 0 in 0.954s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "cinder-quobyte-54e37848-01e3-450a-802e-d009a5f8b3d6" released by "delete_volume" :: held 1.994s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:42 devstack cinder-volume[86913]: WARNING cinder.quota [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:53:42 devstack cinder-volume[86913]: WARNING cinder.quota [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Created reservations ['90a71b3f-dbe9-4570-bb8e-b83b81a96a7d', 'e455e1f9-0bee-42c2-818c-164fb17fd762', 'e34927de-69a5-4785-9d80-1e1dbe4b3e19', '2fe1869d-9b57-4fd7-ae8e-899ffe73bb6f'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:42 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:42 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:42 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-564b59f9-deae-465c-8a64-9402aa66e79d" returned: 0 in 1.031s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-quobyte-564b59f9-deae-465c-8a64-9402aa66e79d" released by "delete_volume" :: held 2.294s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Created reservations ['837123fe-11e3-4537-a1df-a92839d90581', 'f750b517-04e9-43b4-9eb6-de49cd974170', '9d4e840c-b613-42bb-8e87-d9dd35f38cbc', 'de1082d8-9945-476c-8409-91981359f5d5'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:42 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905" returned: 0 in 1.067s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:42 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905 Jul 08 10:53:42 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:43 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:43 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:43 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.024s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:43 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:43 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Deleted volume successfully. Jul 08 10:53:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-39d4db1c-2f9a-4991-8d5f-450f08aa7489 tempest-VolumeRetypeWithoutMigrationTest-301354142 None] Lock "cinder-54e37848-01e3-450a-802e-d009a5f8b3d6-delete_volume" released by "delete_volume" :: held 3.367s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:44 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953.7c652446-e815-4adf-a511-2ab0028e7905" returned: 0 in 1.381s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:44 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-7c652446-e815-4adf-a511-2ab0028e7905" released by "_delete_snapshot" :: held 4.910s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.364s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:44 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Deleted volume successfully. Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-9d3e74b3-de15-463f-bf2d-18ee848d9953" released by "delete_snapshot" :: held 4.960s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6dea4995-8a7c-4d45-ad15-427c71ac4506 tempest-SnapshotDependencyTests-1367780590 None] Lock "cinder-564b59f9-deae-465c-8a64-9402aa66e79d-delete_volume" released by "delete_volume" :: held 4.030s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created reservations ['834c0dbe-8cd1-4a69-9afd-d253d61d03c5', 'beba59a9-3f77-4363-bc12-875a06118d68', 'fca457bf-1559-474b-8569-a4e8b8625e39', 'ba545155-62c6-42e1-8950-5792bf50676b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:44 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Delete snapshot completed successfully. Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-26245606-774c-4b92-ace4-75c86d9cbf35 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-7c652446-e815-4adf-a511-2ab0028e7905-delete_snapshot" released by "delete_snapshot" :: held 5.197s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-9d3e74b3-de15-463f-bf2d-18ee848d9953-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-9d3e74b3-de15-463f-bf2d-18ee848d9953-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "cinder-quobyte-9d3e74b3-de15-463f-bf2d-18ee848d9953" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-9d3e74b3-de15-463f-bf2d-18ee848d9953" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:45 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee06d12-800a-4371-b22b-3dce562e07c8]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:45 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 Jul 08 10:53:45 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:45 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953" returned: 0 in 0.954s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:46 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953 Jul 08 10:53:46 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:46 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9d3e74b3-de15-463f-bf2d-18ee848d9953" returned: 0 in 0.783s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-quobyte-9d3e74b3-de15-463f-bf2d-18ee848d9953" released by "delete_volume" :: held 1.814s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:46 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Created reservations ['52bf2104-01ea-4014-a4b9-6eaf19488776', '0e923d35-6983-4769-949a-15e77bc56e80', '404543bd-6203-4dc8-a08b-34dca47c2c27', '564302dd-9043-4d31-8dc4-de72bea43638'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:53:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:47 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:47 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:47 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.868s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:47 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Deleted volume successfully. Jul 08 10:53:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-df1eeb16-f36a-456e-adfd-e4b3aba8f155 tempest-CreateVolumesFromSnapshotTest-1560056606 None] Lock "cinder-9d3e74b3-de15-463f-bf2d-18ee848d9953-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (845d05c0-bb36-4195-98bc-423f912d22cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69db1b5-0d74-4f16-a728-85352063b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69db1b5-0d74-4f16-a728-85352063b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1362600751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12efdbe9-5bb2-447f-a99b-082d168d811d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:52Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f2469e-4146-45ea-aac7-47cc780943a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f2469e-4146-45ea-aac7-47cc780943a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af60f250-6261-4729-b2f0-ad568c9537ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af60f250-6261-4729-b2f0-ad568c9537ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12efdbe9-5bb2-447f-a99b-082d168d811d', 'volume_name': 'volume-12efdbe9-5bb2-447f-a99b-082d168d811d', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f9cdc9-2fe7-4fd5-80e0-22d68080325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f9cdc9-2fe7-4fd5-80e0-22d68080325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2750b0d4-cd0e-43c7-a20e-64ddaed6e2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:52 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume 12efdbe9-5bb2-447f-a99b-082d168d811d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12efdbe9-5bb2-447f-a99b-082d168d811d', 'volume_size': 1} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1362600751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12efdbe9-5bb2-447f-a99b-082d168d811d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:52Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Creating volume 12efdbe9-5bb2-447f-a99b-082d168d811d {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:52 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:52 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d 1073741824 Jul 08 10:53:52 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Flow 'volume_create_manager' (23b54d6d-096f-434c-a760-f74bb71b5fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2051235e-9f9f-4ee4-9199-161ae9717f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2051235e-9f9f-4ee4-9199-161ae9717f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1490263601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040b1438-38e1-447f-9701-2af47f72ed1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c147432bea4788a30d68f6b7565a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:52Z,use_quota=True,user_id='0a0bbdd315c849dd9d5696b447e420e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cfa5ee-98f7-4976-ae5c-5b93c04ddc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cfa5ee-98f7-4976-ae5c-5b93c04ddc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410225a0-75c1-4a0c-9753-e7a07c7ad53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410225a0-75c1-4a0c-9753-e7a07c7ad53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040b1438-38e1-447f-9701-2af47f72ed1b', 'volume_name': 'volume-040b1438-38e1-447f-9701-2af47f72ed1b', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10674bf-0cbf-4bcf-ad59-45adbb09d2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10674bf-0cbf-4bcf-ad59-45adbb09d2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1683f2da-2605-438a-956a-9eea065426d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:52 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Volume 040b1438-38e1-447f-9701-2af47f72ed1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040b1438-38e1-447f-9701-2af47f72ed1b', 'volume_size': 1} Jul 08 10:53:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:53 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d 1073741824" returned: 0 in 1.103s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:53 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d Jul 08 10:53:53 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:53:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:53 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:53:53 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:54 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d" returned: 0 in 1.104s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.851s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1490263601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040b1438-38e1-447f-9701-2af47f72ed1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c147432bea4788a30d68f6b7565a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:52Z,use_quota=True,user_id='0a0bbdd315c849dd9d5696b447e420e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Creating volume 040b1438-38e1-447f-9701-2af47f72ed1b {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:54 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2750b0d4-cd0e-43c7-a20e-64ddaed6e2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12efdbe9-5bb2-447f-a99b-082d168d811d', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e98d595-5ac7-4254-bdb1-2eac0f233462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:54 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b 1073741824 Jul 08 10:53:54 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:54 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume volume-12efdbe9-5bb2-447f-a99b-082d168d811d (12efdbe9-5bb2-447f-a99b-082d168d811d): created successfully Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e98d595-5ac7-4254-bdb1-2eac0f233462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (845d05c0-bb36-4195-98bc-423f912d22cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:54 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d84a802d-633d-4f8d-af18-66e3fabcfb11 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created volume successfully. Jul 08 10:53:55 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.263s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:55 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:53:55 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:53:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:53:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (6b303088-05b7-4ee8-86fa-7851a55e7686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99c2772-bccf-471a-9755-e342e8d98547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99c2772-bccf-471a-9755-e342e8d98547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-955177822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:56Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e50386-dd23-4418-afa1-5120af18e456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:56 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e50386-dd23-4418-afa1-5120af18e456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090b7d4f-59d8-4e20-95a9-28c136fc5b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090b7d4f-59d8-4e20-95a9-28c136fc5b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471', 'volume_name': 'volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f7c805-3deb-4c54-93ee-733e050a2e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f7c805-3deb-4c54-93ee-733e050a2e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea06add-8637-4826-88a2-393492578d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:56 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471', 'volume_size': 1} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b 1073741824" returned: 0 in 1.946s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:56 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b Jul 08 10:53:56 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (1fe71a3f-69ff-40f2-8750-ab6d4350597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5503311d-b344-4297-8800-0f0eca25be1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5503311d-b344-4297-8800-0f0eca25be1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-180813912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5397508-e170-49e1-8681-da7196c1a3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:57Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3b4357-c4fe-4220-8c0b-58b77fe2de17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3b4357-c4fe-4220-8c0b-58b77fe2de17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bff319c-7c0c-496d-a75a-5c396d796c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bff319c-7c0c-496d-a75a-5c396d796c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5397508-e170-49e1-8681-da7196c1a3dc', 'volume_name': 'volume-d5397508-e170-49e1-8681-da7196c1a3dc', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3eae12-e5db-495d-89ea-1453064972bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3eae12-e5db-495d-89ea-1453064972bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972870e3-9921-49ef-96da-5911c6d4ef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:57 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume d5397508-e170-49e1-8681-da7196c1a3dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5397508-e170-49e1-8681-da7196c1a3dc', 'volume_size': 1} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:57 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b" returned: 0 in 0.978s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] <== create_volume: return (2978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.982s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.030s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-955177822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:56Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Creating volume b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:53:57 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:57 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471 1073741824 Jul 08 10:53:57 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1683f2da-2605-438a-956a-9eea065426d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040b1438-38e1-447f-9701-2af47f72ed1b', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7a896d-e386-472e-bea1-13d8f56aaeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:57 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Volume volume-040b1438-38e1-447f-9701-2af47f72ed1b (040b1438-38e1-447f-9701-2af47f72ed1b): created successfully Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7a896d-e386-472e-bea1-13d8f56aaeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Flow 'volume_create_manager' (23b54d6d-096f-434c-a760-f74bb71b5fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:57 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ffe31e92-4976-4c57-b2e8-7b4e6962d667 tempest-VolumesServicesTestJSON-589982008 None] Created volume successfully. Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (a4566d92-81e2-4fc5-ae48-7ff873075070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a319e67a-b766-4427-836b-6befaa0665f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a319e67a-b766-4427-836b-6befaa0665f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1585395238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136ed723-8e15-47ef-b92e-ba8081271bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:58Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775742fb-c037-4360-ab1c-b9c3393d440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775742fb-c037-4360-ab1c-b9c3393d440e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc9c360-8bc0-40c9-b9d4-87d533a3a9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc9c360-8bc0-40c9-b9d4-87d533a3a9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136ed723-8e15-47ef-b92e-ba8081271bca', 'volume_name': 'volume-136ed723-8e15-47ef-b92e-ba8081271bca', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9190c8e4-a296-4094-b569-8a0f0645851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9190c8e4-a296-4094-b569-8a0f0645851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035d54da-75ff-436d-bbfc-aabae8b86633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:57 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume 136ed723-8e15-47ef-b92e-ba8081271bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136ed723-8e15-47ef-b92e-ba8081271bca', 'volume_size': 1} Jul 08 10:53:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (e5b30143-3454-44d2-9a74-0395326857cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6de598-73e3-4d9d-9212-2d0bcce65b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6de598-73e3-4d9d-9212-2d0bcce65b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069496717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:58Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cdf923-8b09-4ed3-90a0-96ebf4ac03e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cdf923-8b09-4ed3-90a0-96ebf4ac03e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4180bc0b-9f8f-4ece-a8ad-ee32c633bdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4180bc0b-9f8f-4ece-a8ad-ee32c633bdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434', 'volume_name': 'volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc86e904-8202-4284-bc49-ab3767509a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc86e904-8202-4284-bc49-ab3767509a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd48c1cb-97bc-4eb0-8c96-0e89b200e062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:58 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume 4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434', 'volume_size': 1} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Acquiring lock "cinder-040b1438-38e1-447f-9701-2af47f72ed1b-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Lock "cinder-040b1438-38e1-447f-9701-2af47f72ed1b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Acquiring lock "cinder-quobyte-040b1438-38e1-447f-9701-2af47f72ed1b" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Lock "cinder-quobyte-040b1438-38e1-447f-9701-2af47f72ed1b" acquired by "delete_volume" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e220a20-4576-4d48-a1d6-ec5a1c464bbc]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:53:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:59 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471 1073741824" returned: 0 in 1.526s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:53:59 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b Jul 08 10:53:59 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:53:59 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471 Jul 08 10:53:59 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (41c78879-d010-4951-9bab-82a46a94237d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7061a8e8-88ab-4363-a6f5-9250aa243cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7061a8e8-88ab-4363-a6f5-9250aa243cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1095464421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e3d51d-883c-477a-9610-8d4a88323a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:59Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6765f07c-2262-4858-bae1-5437b1c17033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6765f07c-2262-4858-bae1-5437b1c17033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f0f0a4-2297-4673-a2d9-97b445dceece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f0f0a4-2297-4673-a2d9-97b445dceece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e3d51d-883c-477a-9610-8d4a88323a30', 'volume_name': 'volume-66e3d51d-883c-477a-9610-8d4a88323a30', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615e6559-a969-4392-abe5-b0ffb73f6b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615e6559-a969-4392-abe5-b0ffb73f6b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5adc625-9a13-4cbc-b563-e0d37dc0d801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:53:59 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume 66e3d51d-883c-477a-9610-8d4a88323a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e3d51d-883c-477a-9610-8d4a88323a30', 'volume_size': 1} Jul 08 10:53:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:00 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471" returned: 0 in 0.912s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] <== create_volume: return (2492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.495s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.662s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-180813912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5397508-e170-49e1-8681-da7196c1a3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:57Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Creating volume d5397508-e170-49e1-8681-da7196c1a3dc {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:54:00 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea06add-8637-4826-88a2-393492578d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:00 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc 1073741824 Jul 08 10:54:00 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c875e7-7c33-4445-b5af-1dc2219973ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:00 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b" returned: 0 in 1.275s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:00 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471 (b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471): created successfully Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c875e7-7c33-4445-b5af-1dc2219973ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:00 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b Jul 08 10:54:00 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (6b303088-05b7-4ee8-86fa-7851a55e7686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:00 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-03c7af4f-220d-4cd1-bc83-aab4ceb5ddc3 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created volume successfully. Jul 08 10:54:00 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-040b1438-38e1-447f-9701-2af47f72ed1b" returned: 0 in 0.708s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Lock "cinder-quobyte-040b1438-38e1-447f-9701-2af47f72ed1b" released by "delete_volume" :: held 2.067s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Created reservations ['b7b6cfbf-677d-4d55-ba1c-e3ce276d5c27', 'ab34f03f-b5bc-48dd-802d-1e887a9a7cd7', '8ae7d738-a589-4000-99eb-88cc388d2f66', '9c651b8a-08c0-450a-be74-ef5aac858857'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:01 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:01 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:01 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc 1073741824" returned: 0 in 0.975s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:01 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc Jul 08 10:54:01 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:01 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.713s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:01 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Deleted volume successfully. Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-21e6f080-d574-4248-8da9-0100358a99ba tempest-VolumesServicesTestJSON-589982008 None] Lock "cinder-040b1438-38e1-447f-9701-2af47f72ed1b-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:01 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc" returned: 0 in 0.691s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.940s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1585395238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136ed723-8e15-47ef-b92e-ba8081271bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:58Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Creating volume 136ed723-8e15-47ef-b92e-ba8081271bca {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:54:01 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:01 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca 1073741824 Jul 08 10:54:01 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972870e3-9921-49ef-96da-5911c6d4ef9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5397508-e170-49e1-8681-da7196c1a3dc', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091de80f-1e2a-47c3-8847-993e96b067e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:01 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume volume-d5397508-e170-49e1-8681-da7196c1a3dc (d5397508-e170-49e1-8681-da7196c1a3dc): created successfully Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091de80f-1e2a-47c3-8847-993e96b067e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (1fe71a3f-69ff-40f2-8750-ab6d4350597e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:01 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f9777778-bf0b-4b1c-b038-5e11469299a6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created volume successfully. Jul 08 10:54:02 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca 1073741824" returned: 0 in 0.913s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:02 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca Jul 08 10:54:02 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:03 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca" returned: 0 in 0.684s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.863s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069496717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:58Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Creating volume 4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:54:03 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035d54da-75ff-436d-bbfc-aabae8b86633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136ed723-8e15-47ef-b92e-ba8081271bca', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:03 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434 1073741824 Jul 08 10:54:03 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa5abe0-3e3d-4065-ab93-d6ff8530653d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:03 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume volume-136ed723-8e15-47ef-b92e-ba8081271bca (136ed723-8e15-47ef-b92e-ba8081271bca): created successfully Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa5abe0-3e3d-4065-ab93-d6ff8530653d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (a4566d92-81e2-4fc5-ae48-7ff873075070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:03 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-db6186f7-cb1c-4653-9de6-bb43d4d4693b tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created volume successfully. Jul 08 10:54:04 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434 1073741824" returned: 0 in 0.943s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:04 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434 Jul 08 10:54:04 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:05 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434" returned: 0 in 0.806s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.676s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1095464421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e3d51d-883c-477a-9610-8d4a88323a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677eb4f752ae41259fce2aa307150cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:53:59Z,use_quota=True,user_id='19cf5f977eb340869b1af18361f78c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Creating volume 66e3d51d-883c-477a-9610-8d4a88323a30 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:54:05 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:05 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30 1073741824 Jul 08 10:54:05 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd48c1cb-97bc-4eb0-8c96-0e89b200e062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac57178-cef3-4433-876f-e8bdfbe23364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:05 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434 (4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434): created successfully Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac57178-cef3-4433-876f-e8bdfbe23364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (e5b30143-3454-44d2-9a74-0395326857cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e3a6c9a2-bdd6-445f-8fc0-037f41c9948a tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created volume successfully. Jul 08 10:54:06 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30 1073741824" returned: 0 in 1.051s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:06 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30 Jul 08 10:54:06 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Flow 'volume_create_manager' (edb3e57a-57b3-46ff-a608-72a6af7ca265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4dec24-cc39-48a5-b129-f04a29f7dc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4dec24-cc39-48a5-b129-f04a29f7dc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-403020933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d15e24-5323-4bea-a859-24d8ec0b4561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766c4d2eee664d7b9113bfa6d68b6013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:07Z,use_quota=True,user_id='e4b75498aaf74ba981f63dff20189742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db8fbbc-ee35-4cd1-b186-181f9271b0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db8fbbc-ee35-4cd1-b186-181f9271b0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c409caf4-679e-4f80-8c3a-153e6e9d114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c409caf4-679e-4f80-8c3a-153e6e9d114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d15e24-5323-4bea-a859-24d8ec0b4561', 'volume_name': 'volume-a1d15e24-5323-4bea-a859-24d8ec0b4561', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352b09eb-904f-4225-979a-ef60a782fe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352b09eb-904f-4225-979a-ef60a782fe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5db4d9-7588-4d79-a01f-4f3a9740695a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:06 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Volume a1d15e24-5323-4bea-a859-24d8ec0b4561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d15e24-5323-4bea-a859-24d8ec0b4561', 'volume_size': 1} Jul 08 10:54:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:07 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30" returned: 0 in 0.738s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.213s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-403020933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d15e24-5323-4bea-a859-24d8ec0b4561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766c4d2eee664d7b9113bfa6d68b6013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:07Z,use_quota=True,user_id='e4b75498aaf74ba981f63dff20189742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Creating volume a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:54:07 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:07 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 1073741824 Jul 08 10:54:07 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5adc625-9a13-4cbc-b563-e0d37dc0d801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e3d51d-883c-477a-9610-8d4a88323a30', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d61ef87-b396-4af7-8c33-1640dfc43695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:07 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Volume volume-66e3d51d-883c-477a-9610-8d4a88323a30 (66e3d51d-883c-477a-9610-8d4a88323a30): created successfully Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d61ef87-b396-4af7-8c33-1640dfc43695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:07 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Flow 'volume_create_manager' (41c78879-d010-4951-9bab-82a46a94237d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:07 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2f1d709e-12fc-4603-a6a0-1328d02bf866 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created volume successfully. Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-66e3d51d-883c-477a-9610-8d4a88323a30-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:08 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 1073741824" returned: 0 in 0.967s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-66e3d51d-883c-477a-9610-8d4a88323a30-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-quobyte-66e3d51d-883c-477a-9610-8d4a88323a30" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-66e3d51d-883c-477a-9610-8d4a88323a30" acquired by "delete_volume" :: waited 0.031s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:08 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 Jul 08 10:54:08 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1b9f68-2af5-447e-aee2-0cdd84d8271a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:08 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30 Jul 08 10:54:08 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:08 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561" returned: 0 in 0.717s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5db4d9-7588-4d79-a01f-4f3a9740695a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d15e24-5323-4bea-a859-24d8ec0b4561', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a817f9cb-58e9-44b1-b3c3-df1842472b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:08 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Volume volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 (a1d15e24-5323-4bea-a859-24d8ec0b4561): created successfully Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a817f9cb-58e9-44b1-b3c3-df1842472b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Flow 'volume_create_manager' (edb3e57a-57b3-46ff-a608-72a6af7ca265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:08 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8d1900a3-e49a-4a6d-ad85-2c09ce624b38 tempest-VolumesDeleteCascade-327605379 None] Created volume successfully. Jul 08 10:54:09 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30" returned: 0 in 0.896s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:09 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30 Jul 08 10:54:09 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:09 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-66e3d51d-883c-477a-9610-8d4a88323a30" returned: 0 in 0.754s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-66e3d51d-883c-477a-9610-8d4a88323a30" released by "delete_volume" :: held 1.708s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:09 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created reservations ['50f2acab-1fb6-4372-944d-721e1266a4e5', '337fba8d-cee3-4d44-90e9-c829e5b4f23d', 'edc0d773-ebf4-4e5b-8367-f545fe7fc433', '9deb7e43-a05b-4a4a-a738-059141a658c8'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:10 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:10 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] Creating offline snapshot 77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 of volume a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d53279e-ff37-423e-ad50-61b428bae8b3]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:10 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 Jul 08 10:54:10 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-quobyte-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c51792b-364e-46be-b5e1-17b8aa057178]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:10 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434 Jul 08 10:54:10 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Acquiring lock "cinder-4b5af349-41a5-4a14-bb7f-cc0137f54e60-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Lock "cinder-4b5af349-41a5-4a14-bb7f-cc0137f54e60-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Acquiring lock "cinder-quobyte-4b5af349-41a5-4a14-bb7f-cc0137f54e60" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Lock "cinder-quobyte-4b5af349-41a5-4a14-bb7f-cc0137f54e60" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:11 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[61113cca-fae4-4923-a72f-b0571527aa36]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:11 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.016s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:11 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:11 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Deleted volume successfully. Jul 08 10:54:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b81a222a-505f-40d6-8c44-29117a2a9293 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-66e3d51d-883c-477a-9610-8d4a88323a30-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:11 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60 Jul 08 10:54:11 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:11 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561" returned: 0 in 0.946s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:11 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 1G Jul 08 10:54:11 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:11 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434" returned: 0 in 0.928s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:11 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434 Jul 08 10:54:11 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:11 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60" returned: 0 in 0.857s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:11 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60 Jul 08 10:54:11 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:12 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434" returned: 0 in 0.679s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434" released by "delete_volume" :: held 1.678s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:12 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 1G" returned: 0 in 0.943s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:12 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 Jul 08 10:54:12 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created reservations ['97c824a6-2bf9-45e2-93d8-9d1b6ff2c196', '5c852501-3407-4bb0-8fb0-2680f4819d68', '234e0f44-82c9-4796-9135-26a50c5d522a', '87d19b5d-e05b-4063-9595-f54cdfc69e5b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:12 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:12 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:12 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4b5af349-41a5-4a14-bb7f-cc0137f54e60" returned: 0 in 0.722s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Lock "cinder-quobyte-4b5af349-41a5-4a14-bb7f-cc0137f54e60" released by "delete_volume" :: held 1.654s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-136ed723-8e15-47ef-b92e-ba8081271bca-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-136ed723-8e15-47ef-b92e-ba8081271bca-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Created reservations ['e54356f0-00ba-469f-b030-f71ab1e8cc0a', '0057e60b-5d95-4d6a-83a0-0fabb3282d50', '7232f804-662b-475c-a802-4e284998e981', 'fea42f92-a446-4e03-b4e0-3e60a4d7d1b1'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-quobyte-136ed723-8e15-47ef-b92e-ba8081271bca" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-136ed723-8e15-47ef-b92e-ba8081271bca" acquired by "delete_volume" :: waited 0.040s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b850976-967e-4382-aec2-06b3e5e3c999]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:12 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:12 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:12 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74" returned: 0 in 0.857s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:12 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 is being set with open permissions: ugo+rw Jul 08 10:54:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:12 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca Jul 08 10:54:13 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:13 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 Jul 08 10:54:13 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:13 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.773s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:13 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:13 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Deleted volume successfully. Jul 08 10:54:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-579ca628-3ff8-4af1-8b81-92702e738eef tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-4cf8e7a3-3ad5-4d95-b1b8-bf8e6a3cd434-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:13 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.858s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:13 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:13 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Deleted volume successfully. Jul 08 10:54:13 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74" returned: 0 in 0.774s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-908b2ebe-9606-47b4-a03d-619e44157186 tempest-VolumesNegativeTest-1824605826 None] Lock "cinder-4b5af349-41a5-4a14-bb7f-cc0137f54e60-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:13 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca" returned: 0 in 0.937s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:13 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca Jul 08 10:54:13 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:13 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.info Jul 08 10:54:13 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:14 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.info" returned: 0 in 0.778s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:14 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.info is being set with open permissions: ugo+rw Jul 08 10:54:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:14 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-136ed723-8e15-47ef-b92e-ba8081271bca" returned: 0 in 0.822s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:14 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.info Jul 08 10:54:14 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-136ed723-8e15-47ef-b92e-ba8081271bca" released by "delete_volume" :: held 1.812s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:14 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created reservations ['9c4dbb48-9406-4af3-b11a-30f550e6e925', '9dfb8772-4d44-449f-b712-dd2bfce7eee5', '2b12488b-551c-44c2-a93d-1cfa28bbe0da', '1a830c63-e8b5-40d3-8735-20c65edfd089'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:14 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:14 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-d5397508-e170-49e1-8681-da7196c1a3dc-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-d5397508-e170-49e1-8681-da7196c1a3dc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-quobyte-d5397508-e170-49e1-8681-da7196c1a3dc" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-d5397508-e170-49e1-8681-da7196c1a3dc" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd71454-15ba-48d6-a7a3-af00f4755a44]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:15 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc Jul 08 10:54:15 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:15 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.info" returned: 0 in 0.812s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.253s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:15 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1fcdc5aa-be23-4556-8add-182be8b8107f tempest-VolumesDeleteCascade-327605379 None] Create snapshot completed successfully Jul 08 10:54:15 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.877s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:15 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Deleted volume successfully. Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ab3d67d6-11c6-4e20-b79a-838d2b36f7d6 tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-136ed723-8e15-47ef-b92e-ba8081271bca-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:15 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc" returned: 0 in 0.832s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:16 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc Jul 08 10:54:16 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] Creating offline snapshot 84892d2a-4dc2-4a60-97a6-2d6e6a548135 of volume a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:54:16 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5397508-e170-49e1-8681-da7196c1a3dc" returned: 0 in 0.793s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:16 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ec9c8e-c713-41b3-9bec-752737e1ebd3]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-d5397508-e170-49e1-8681-da7196c1a3dc" released by "delete_volume" :: held 1.690s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:16 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created reservations ['5b6e78df-35b2-428b-8df0-357ef339d8d6', '1ad06cea-e578-46c2-a351-9600673bdaed', '6162abb5-9fc9-4f22-82bc-31ced15abcd8', 'ce2c54ee-5685-4c5a-a80a-9d80dd927b49'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:16 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 Jul 08 10:54:16 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:17 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:17 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-quobyte-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[e206a049-f457-45dc-a305-76dddf7eb0be]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:17 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471 Jul 08 10:54:17 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:17 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.753s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:17 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Deleted volume successfully. Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c9947194-1101-4aff-86ef-6dc1f3c316fe tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-d5397508-e170-49e1-8681-da7196c1a3dc-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:17 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74" returned: 0 in 1.013s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d15e24-5323-4bea-a859-24d8ec0b4561(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:54:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:17 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 1G Jul 08 10:54:17 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:18 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471" returned: 0 in 0.936s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:18 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471 Jul 08 10:54:18 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:18 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 1G" returned: 0 in 1.004s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:18 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 Jul 08 10:54:18 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:19 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471" returned: 0 in 0.713s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471" released by "delete_volume" :: held 1.711s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created reservations ['a31ac110-7c5d-4afb-91b6-5b5696637fd0', '15d0fe66-ddaa-4cad-a17e-9a3c26bcbd69', '516a492e-2d3a-4b31-8e25-4ae8ee80c46c', 'd256965f-8dee-41ae-b430-8792a78dde7c'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:19 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:19 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-12efdbe9-5bb2-447f-a99b-082d168d811d-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:19 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-12efdbe9-5bb2-447f-a99b-082d168d811d-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135" returned: 0 in 0.942s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:19 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 is being set with open permissions: ugo+rw Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:19 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 Jul 08 10:54:19 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "cinder-quobyte-12efdbe9-5bb2-447f-a99b-082d168d811d" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-12efdbe9-5bb2-447f-a99b-082d168d811d" acquired by "delete_volume" :: waited 0.043s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fafc6f-bc5e-46ff-9026-041de776db1a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:20 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d Jul 08 10:54:20 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:20 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.853s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:20 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Deleted volume successfully. Jul 08 10:54:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-06829d44-85c4-4e6c-8d37-22881a9a3ffb tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-b05e0577-e4d6-4bfa-ad4d-3aa2cda5f471-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:20 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135" returned: 0 in 0.819s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.922s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3c4c402f-c3b3-4770-b26e-0a0449b44890 tempest-VolumesDeleteCascade-327605379 None] Create snapshot completed successfully Jul 08 10:54:20 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d" returned: 0 in 0.933s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:20 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d Jul 08 10:54:20 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-a1d15e24-5323-4bea-a859-24d8ec0b4561-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-a1d15e24-5323-4bea-a859-24d8ec0b4561-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Performing cascade delete. {{(pid=86913) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-77f91bfe-2e2e-41e3-86a0-6fa1d1afff74-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-77f91bfe-2e2e-41e3-86a0-6fa1d1afff74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-quobyte-a1d15e24-5323-4bea-a859-24d8ec0b4561" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-a1d15e24-5323-4bea-a859-24d8ec0b4561" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-quobyte-77f91bfe-2e2e-41e3-86a0-6fa1d1afff74" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-77f91bfe-2e2e-41e3-86a0-6fa1d1afff74" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Deleting offline snapshot 77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 of volume a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] snapshot_file for this snap is: volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[9623b058-5c04-47b6-9f7a-e5f9154e2bd0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:21 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 Jul 08 10:54:21 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:21 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-12efdbe9-5bb2-447f-a99b-082d168d811d" returned: 0 in 0.812s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-quobyte-12efdbe9-5bb2-447f-a99b-082d168d811d" released by "delete_volume" :: held 1.831s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Created reservations ['a7df6e46-8a84-4732-a1b5-fb008f5f9909', '88d3124b-d01f-48cc-9bd5-669bb327fcf9', '2fe7c33f-4800-4a32-9f0a-fd8d52b4ab9f', '35907c4d-e36f-429d-8ae2-36f9c55ed269'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:21 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:21 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:22 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74" returned: 0 in 0.935s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d15e24-5323-4bea-a859-24d8ec0b4561(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:54:22 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[af09b6dc-112d-4d56-95b9-d48152cb0dd8]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:22 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 Jul 08 10:54:22 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:22 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.879s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:22 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:22 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Deleted volume successfully. Jul 08 10:54:22 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8d618395-8177-42ff-bcb2-23df6deff33f tempest-CreateVolumesFromSourceVolumeTest-58536536 None] Lock "cinder-12efdbe9-5bb2-447f-a99b-082d168d811d-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:23 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561" returned: 0 in 0.938s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:23 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a0bc18-035b-4bc0-b31a-d5a3d3fb4070]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:23 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 Jul 08 10:54:23 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:24 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135" returned: 0 in 1.066s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d15e24-5323-4bea-a859-24d8ec0b4561(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:54:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6adefa-6b7f-4d87-bf71-7ec7ef4b28b1]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:24 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 Jul 08 10:54:24 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:25 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74" returned: 0 in 0.973s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d15e24-5323-4bea-a859-24d8ec0b4561(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:54:25 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1020008-4c86-4725-96c1-6735fe625eee]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:25 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 Jul 08 10:54:25 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:54:26 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Flow 'volume_create_manager' (a36c7fd7-84f3-4dde-a100-2a315f93287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5005a81f-d25e-430b-80bd-38becd5125df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=197,cinder:SELECT=130,cinder:INSERT=42,cinder:DELETE=11 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561" returned: 0 in 0.975s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5005a81f-d25e-430b-80bd-38becd5125df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448467515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c76a2fc13a4346b9ffb36f90872e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:26Z,use_quota=True,user_id='6e487c7ac7bf4d9e90fe333bcaacb18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:26 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 Jul 08 10:54:26 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf48319e-cafc-42cd-af6f-6edc9810a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf48319e-cafc-42cd-af6f-6edc9810a233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6080942f-6a7e-4c9f-a095-0c0d1dcf9f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6080942f-6a7e-4c9f-a095-0c0d1dcf9f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82', 'volume_name': 'volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6576bc-9194-402b-92df-911167734a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6576bc-9194-402b-92df-911167734a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3203036-0087-4eff-96a5-2b9acc46643e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:26 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Volume 2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82', 'volume_size': 1} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448467515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c76a2fc13a4346b9ffb36f90872e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:26Z,use_quota=True,user_id='6e487c7ac7bf4d9e90fe333bcaacb18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Creating volume 2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:54:26 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:54:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:26 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82 1073741824 Jul 08 10:54:26 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:27 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74" returned: 0 in 1.090s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:27 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74 Jul 08 10:54:27 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:27 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82 1073741824" returned: 0 in 1.169s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:27 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82 Jul 08 10:54:27 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Flow 'volume_create_manager' (56577cad-3281-4224-a3ff-af4beacc2222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ea84af-3846-45dc-ac29-e5e08610ff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ea84af-3846-45dc-ac29-e5e08610ff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-133664282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d6d713-3d6d-4e0a-b242-6e5da0eb1160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc271652b3a4e0298ab9a637b065944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:28Z,use_quota=True,user_id='4c81d18375224c16b2b05738d7ea5d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3807811-1d26-497b-aa7f-59bca4ce12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3807811-1d26-497b-aa7f-59bca4ce12c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afdb076-c1f0-4c4b-947b-631e2e76d872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afdb076-c1f0-4c4b-947b-631e2e76d872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d6d713-3d6d-4e0a-b242-6e5da0eb1160', 'volume_name': 'volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423d80f0-e529-437c-96c2-b859cabdf61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423d80f0-e529-437c-96c2-b859cabdf61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1053317b-3665-441f-b862-02bba6aad520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:28 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Volume 42d6d713-3d6d-4e0a-b242-6e5da0eb1160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160', 'volume_size': 1} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:28 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.77f91bfe-2e2e-41e3-86a0-6fa1d1afff74" returned: 0 in 0.705s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 -F qcow2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:28 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 -F qcow2 Jul 08 10:54:28 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:28 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82" returned: 0 in 0.732s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.374s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-133664282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d6d713-3d6d-4e0a-b242-6e5da0eb1160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc271652b3a4e0298ab9a637b065944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:28Z,use_quota=True,user_id='4c81d18375224c16b2b05738d7ea5d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Creating volume 42d6d713-3d6d-4e0a-b242-6e5da0eb1160 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:54:28 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:28 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 1073741824 Jul 08 10:54:28 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3203036-0087-4eff-96a5-2b9acc46643e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428f6b9d-8929-401a-838b-6bbdca3f2db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:28 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Volume volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82 (2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82): created successfully Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428f6b9d-8929-401a-838b-6bbdca3f2db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Flow 'volume_create_manager' (a36c7fd7-84f3-4dde-a100-2a315f93287d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:28 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c15b5e51-2ea3-4b44-a860-7f2fa4bf477e tempest-ProjectReaderTests-883313890 None] Created volume successfully. Jul 08 10:54:28 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 -F qcow2" returned: 0 in 0.681s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-77f91bfe-2e2e-41e3-86a0-6fa1d1afff74" released by "_delete_snapshot" :: held 7.638s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-a1d15e24-5323-4bea-a859-24d8ec0b4561" released by "delete_snapshot" :: held 7.676s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Created reservations ['c92a82ad-ec20-487b-9ef1-b7b73f839536', '3b2f649a-9620-4985-9c5a-e83a1d153a79', 'a7bcdf4f-71a4-4497-a804-a3fcb9f6d613', 'ef7fb65f-3d05-49b6-b757-aa0bf6a528c9'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Delete snapshot completed successfully. Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-77f91bfe-2e2e-41e3-86a0-6fa1d1afff74-delete_snapshot" released by "delete_snapshot" :: held 7.857s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-84892d2a-4dc2-4a60-97a6-2d6e6a548135-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-84892d2a-4dc2-4a60-97a6-2d6e6a548135-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-quobyte-a1d15e24-5323-4bea-a859-24d8ec0b4561" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-a1d15e24-5323-4bea-a859-24d8ec0b4561" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-quobyte-84892d2a-4dc2-4a60-97a6-2d6e6a548135" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-84892d2a-4dc2-4a60-97a6-2d6e6a548135" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Deleting offline snapshot 84892d2a-4dc2-4a60-97a6-2d6e6a548135 of volume a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] snapshot_file for this snap is: volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9a842a-31fe-485f-bfc2-29d607ba28ba]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:29 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 Jul 08 10:54:29 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:29 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 1073741824" returned: 0 in 0.897s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:29 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 Jul 08 10:54:29 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Acquiring lock "cinder-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Lock "cinder-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Acquiring lock "cinder-quobyte-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Lock "cinder-quobyte-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3b31f3-ef18-4d1b-85e5-338cf60defb4]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:30 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82 Jul 08 10:54:30 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:30 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135" returned: 0 in 0.918s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d15e24-5323-4bea-a859-24d8ec0b4561(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2612356-bce1-496c-a151-63a4a55237b0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:30 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160" returned: 0 in 0.746s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1053317b-3665-441f-b862-02bba6aad520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d588fb-f0cd-4e67-bc6d-7d548faf0817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:30 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Volume volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 (42d6d713-3d6d-4e0a-b242-6e5da0eb1160): created successfully Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d588fb-f0cd-4e67-bc6d-7d548faf0817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Flow 'volume_create_manager' (56577cad-3281-4224-a3ff-af4beacc2222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:30 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ccfbd592-bc67-4a8b-adfc-2d2aaa45c520 tempest-VolumesSnapshotTestJSON-1748779462 None] Created volume successfully. Jul 08 10:54:30 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 Jul 08 10:54:30 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:30 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82" returned: 0 in 0.800s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:30 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82 Jul 08 10:54:30 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:31 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561" returned: 0 in 0.906s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:31 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 Jul 08 10:54:31 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:31 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82" returned: 0 in 0.682s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Lock "cinder-quobyte-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82" released by "delete_volume" :: held 1.560s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Created reservations ['8cc1637c-c8b1-46a6-97e8-d1df6231fb33', '6f1cdcef-cadd-4635-823d-12c45a78764a', 'eacc2c14-fa01-4faa-bd47-16456105a0e0', 'e7eac051-6b40-4381-9be0-3324b840cae8'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] Creating offline snapshot fe0f4597-715c-4d95-8168-8214c18dff21 of volume 42d6d713-3d6d-4e0a-b242-6e5da0eb1160 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb190a5-0ed8-4589-b4e5-83bdb7d9d8ab]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:31 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:31 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:31 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 Jul 08 10:54:31 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:32 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135" returned: 0 in 0.982s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:32 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135 Jul 08 10:54:32 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:32 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.846s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:32 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Deleted volume successfully. Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-15f2c40a-74b8-4793-8316-3b97683a0b5c tempest-ProjectReaderTests-883313890 None] Lock "cinder-2dc86a0a-e0f9-4fa6-84d9-5203d9e66a82-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:32 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:INSERT=47,cinder:UPDATE=191,cinder:SELECT=139,cinder:DELETE=20 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160" returned: 0 in 1.133s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:32 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 1G Jul 08 10:54:32 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Flow 'volume_create_manager' (8d8d703b-8322-449c-ae63-c6265a2c190e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff0f4cd-5ebe-4cfc-b675-bd5e630bd55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff0f4cd-5ebe-4cfc-b675-bd5e630bd55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82281184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88f8e58-ced5-4df0-8dd5-96e964850f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c76a2fc13a4346b9ffb36f90872e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:33Z,use_quota=True,user_id='6e487c7ac7bf4d9e90fe333bcaacb18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ac9bac-2592-4836-bd03-36fd996f5dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ac9bac-2592-4836-bd03-36fd996f5dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c9e205-004a-4416-8284-4b8780c7fea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c9e205-004a-4416-8284-4b8780c7fea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd88f8e58-ced5-4df0-8dd5-96e964850f78', 'volume_name': 'volume-d88f8e58-ced5-4df0-8dd5-96e964850f78', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865e98dc-c62f-48b7-8d28-9d5875836510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865e98dc-c62f-48b7-8d28-9d5875836510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d88c02-efad-4bcf-ac37-f566998913d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:32 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Volume d88f8e58-ced5-4df0-8dd5-96e964850f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d88f8e58-ced5-4df0-8dd5-96e964850f78', 'volume_size': 1} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:32 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561.84892d2a-4dc2-4a60-97a6-2d6e6a548135" returned: 0 in 0.824s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-84892d2a-4dc2-4a60-97a6-2d6e6a548135" released by "_delete_snapshot" :: held 3.730s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-a1d15e24-5323-4bea-a859-24d8ec0b4561" released by "delete_snapshot" :: held 3.754s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:32 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Created reservations ['4eb7b128-e1df-4833-9e09-8b36f67114b3', 'e2d5a37f-0cb0-4b65-a1a8-39888b6d036e', 'c722065d-58ab-4b15-bdb3-1b5befefc1c0', 'b7952151-a42d-4644-a308-d9bc5cb4fbf5'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:32 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Delete snapshot completed successfully. Jul 08 10:54:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-84892d2a-4dc2-4a60-97a6-2d6e6a548135-delete_snapshot" released by "delete_snapshot" :: held 3.912s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Snapshots deleted, issuing volume delete {{(pid=86913) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 10:54:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-quobyte-a1d15e24-5323-4bea-a859-24d8ec0b4561" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-a1d15e24-5323-4bea-a859-24d8ec0b4561" acquired by "delete_volume" :: waited 0.013s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:33 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d2dd1e-e710-4a67-9e61-88f8ae1aa398]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:33 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 Jul 08 10:54:33 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:33 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 1G" returned: 0 in 0.857s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:33 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 Jul 08 10:54:33 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:33 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561" returned: 0 in 0.835s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:33 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561 Jul 08 10:54:33 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:34 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21" returned: 0 in 0.768s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:34 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 is being set with open permissions: ugo+rw Jul 08 10:54:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:34 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 Jul 08 10:54:34 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:34 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a1d15e24-5323-4bea-a859-24d8ec0b4561" returned: 0 in 0.699s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-a1d15e24-5323-4bea-a859-24d8ec0b4561" released by "delete_volume" :: held 1.598s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:34 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Created reservations ['47324574-285c-47c0-b766-a724f63db19f', '8f588989-f8eb-43b7-9ed8-b919c113f1d7', 'a8449886-e85c-4849-98ab-24553151ec91', '589bc34b-8879-4bcb-ad9c-19a118a196fd'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:34 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:34 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:35 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21" returned: 0 in 0.741s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:35 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.info Jul 08 10:54:35 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:35 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.688s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:35 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:35 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Deleted volume successfully. Jul 08 10:54:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-60b079ea-e65b-4f04-ad49-b141150a2b58 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-a1d15e24-5323-4bea-a859-24d8ec0b4561-delete_volume" released by "delete_volume" :: held 14.376s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:35 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.info" returned: 0 in 0.745s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:35 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.info is being set with open permissions: ugo+rw Jul 08 10:54:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:35 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.info Jul 08 10:54:35 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:35 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:54:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Flow 'volume_create_manager' (43f80dc2-381d-4ed3-b85e-35254a159f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a325a2e0-07e4-4263-903a-d20ff1304d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a325a2e0-07e4-4263-903a-d20ff1304d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1669190999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaa8b44-88b9-42a4-b15b-61a6443c18f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766c4d2eee664d7b9113bfa6d68b6013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:36Z,use_quota=True,user_id='e4b75498aaf74ba981f63dff20189742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa526961-264e-48f1-9800-2c3877151bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa526961-264e-48f1-9800-2c3877151bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c94d7e3-c9ef-4646-9b24-b0328af5edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c94d7e3-c9ef-4646-9b24-b0328af5edd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aaa8b44-88b9-42a4-b15b-61a6443c18f9', 'volume_name': 'volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea6b4aa-8b0a-4c5e-9701-5972b78db2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea6b4aa-8b0a-4c5e-9701-5972b78db2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc1e160-a561-460a-8299-6e3e3ef4aee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:36 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Volume 8aaa8b44-88b9-42a4-b15b-61a6443c18f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9', 'volume_size': 1} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:36 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.info" returned: 0 in 0.656s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.703s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82281184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88f8e58-ced5-4df0-8dd5-96e964850f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c76a2fc13a4346b9ffb36f90872e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:33Z,use_quota=True,user_id='6e487c7ac7bf4d9e90fe333bcaacb18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Creating volume d88f8e58-ced5-4df0-8dd5-96e964850f78 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:54:36 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:36 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78 1073741824 Jul 08 10:54:36 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:36 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3188d951-50d3-4ba2-b94f-628774c70e33 tempest-VolumesSnapshotTestJSON-1748779462 None] Create snapshot completed successfully Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-fe0f4597-715c-4d95-8168-8214c18dff21-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-fe0f4597-715c-4d95-8168-8214c18dff21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-42d6d713-3d6d-4e0a-b242-6e5da0eb1160" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-42d6d713-3d6d-4e0a-b242-6e5da0eb1160" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-fe0f4597-715c-4d95-8168-8214c18dff21" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-fe0f4597-715c-4d95-8168-8214c18dff21" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Deleting offline snapshot fe0f4597-715c-4d95-8168-8214c18dff21 of volume 42d6d713-3d6d-4e0a-b242-6e5da0eb1160 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:54:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] snapshot_file for this snap is: volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:54:37 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a344cf80-fb7d-40c5-b730-5c28fbef178b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:37 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 Jul 08 10:54:37 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:37 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78 1073741824" returned: 0 in 0.965s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:37 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78 Jul 08 10:54:37 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:37 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21" returned: 0 in 0.762s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:54:37 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab25f7fb-6245-4441-a04f-bca546e92a92]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:37 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 Jul 08 10:54:37 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:38 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78" returned: 0 in 0.706s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.158s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1669190999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaa8b44-88b9-42a4-b15b-61a6443c18f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766c4d2eee664d7b9113bfa6d68b6013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:36Z,use_quota=True,user_id='e4b75498aaf74ba981f63dff20189742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Creating volume 8aaa8b44-88b9-42a4-b15b-61a6443c18f9 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:54:38 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:38 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 1073741824 Jul 08 10:54:38 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d88c02-efad-4bcf-ac37-f566998913d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d88f8e58-ced5-4df0-8dd5-96e964850f78', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4ea05a-501c-4bc3-8ecb-c00ca7338724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:38 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Volume volume-d88f8e58-ced5-4df0-8dd5-96e964850f78 (d88f8e58-ced5-4df0-8dd5-96e964850f78): created successfully Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4ea05a-501c-4bc3-8ecb-c00ca7338724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Flow 'volume_create_manager' (8d8d703b-8322-449c-ae63-c6265a2c190e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:38 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-574072d7-3b95-4d8c-b952-1182e93f1c23 tempest-ProjectReaderTests-883313890 None] Created volume successfully. Jul 08 10:54:38 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160" returned: 0 in 0.861s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:38 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 Jul 08 10:54:38 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Acquiring lock "cinder-d88f8e58-ced5-4df0-8dd5-96e964850f78-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Lock "cinder-d88f8e58-ced5-4df0-8dd5-96e964850f78-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:39 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 1073741824" returned: 0 in 0.903s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Acquiring lock "cinder-quobyte-d88f8e58-ced5-4df0-8dd5-96e964850f78" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Lock "cinder-quobyte-d88f8e58-ced5-4df0-8dd5-96e964850f78" acquired by "delete_volume" :: waited 0.031s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:39 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 Jul 08 10:54:39 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8587020d-8eca-45a2-9075-6666eacea985]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:39 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78 Jul 08 10:54:39 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:39 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21" returned: 0 in 0.814s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:39 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21 Jul 08 10:54:39 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:39 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" returned: 0 in 0.692s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc1e160-a561-460a-8299-6e3e3ef4aee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc05a84b-5e92-4382-ac7d-0af6dbca0f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:39 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Volume volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 (8aaa8b44-88b9-42a4-b15b-61a6443c18f9): created successfully Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc05a84b-5e92-4382-ac7d-0af6dbca0f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Flow 'volume_create_manager' (43f80dc2-381d-4ed3-b85e-35254a159f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5e0c3189-6395-4f46-8197-8fd5c1b9ee31 tempest-VolumesDeleteCascade-327605379 None] Created volume successfully. Jul 08 10:54:40 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78" returned: 0 in 0.845s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:40 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78 Jul 08 10:54:40 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:40 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160.fe0f4597-715c-4d95-8168-8214c18dff21" returned: 0 in 0.740s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-fe0f4597-715c-4d95-8168-8214c18dff21" released by "_delete_snapshot" :: held 3.310s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-42d6d713-3d6d-4e0a-b242-6e5da0eb1160" released by "delete_snapshot" :: held 3.340s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Created reservations ['23faf56e-80c8-4133-a96f-5c075105f515', 'ee67289c-a7ad-43ac-abab-3db642c7dd4e', '9f87d40b-1155-4cf2-9e24-9ffe2da64d44', 'e3521bba-631b-432b-9250-69185f8c93b4'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Delete snapshot completed successfully. Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] Creating offline snapshot 03a2bd83-ccda-46cd-a99d-fbf78b256045 of volume 8aaa8b44-88b9-42a4-b15b-61a6443c18f9 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5fa94289-5e12-4b9a-b028-1a0b3b8eba98 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-fe0f4597-715c-4d95-8168-8214c18dff21-delete_snapshot" released by "delete_snapshot" :: held 3.567s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90735c2-54af-481f-bee3-03f5ffbb0f4d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:40 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 Jul 08 10:54:40 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:40 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d88f8e58-ced5-4df0-8dd5-96e964850f78" returned: 0 in 0.734s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Lock "cinder-quobyte-d88f8e58-ced5-4df0-8dd5-96e964850f78" released by "delete_volume" :: held 1.638s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Created reservations ['ace49b51-9877-49fb-b6ad-726d16916f9c', 'f9678156-f47d-45e4-bd6b-80565b53a69b', 'b99a4376-5cc9-4b1b-b610-439fc8f49394', 'af5101ef-2a88-4e05-8762-9cd5a64d6eeb'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:41 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:41 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:41 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" returned: 0 in 0.809s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:41 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 1G Jul 08 10:54:41 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:41 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.801s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:41 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Deleted volume successfully. Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dd6dbf0e-6a91-4b20-847c-fe339fc46214 tempest-ProjectReaderTests-883313890 None] Lock "cinder-d88f8e58-ced5-4df0-8dd5-96e964850f78-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Flow 'volume_create_manager' (0c893293-4cfe-4d4a-917a-64f70bea444d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f507eb-b27c-47f0-b212-8c6247c2b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f507eb-b27c-47f0-b212-8c6247c2b636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-976329264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc1d72e-f507-4c23-b976-410ec12ef93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc271652b3a4e0298ab9a637b065944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:42Z,use_quota=True,user_id='4c81d18375224c16b2b05738d7ea5d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa83a321-044a-4963-9663-fe8f4884f681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa83a321-044a-4963-9663-fe8f4884f681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dec89a-f688-42f1-b485-02aece606bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dec89a-f688-42f1-b485-02aece606bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc1d72e-f507-4c23-b976-410ec12ef93c', 'volume_name': 'volume-3bc1d72e-f507-4c23-b976-410ec12ef93c', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68ad372-0540-4970-85cc-68f09af334fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68ad372-0540-4970-85cc-68f09af334fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0652a52f-530f-4546-9627-d0cd3fc9135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:41 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Volume 3bc1d72e-f507-4c23-b976-410ec12ef93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc1d72e-f507-4c23-b976-410ec12ef93c', 'volume_size': 1} Jul 08 10:54:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:42 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 1G" returned: 0 in 0.996s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:42 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 Jul 08 10:54:42 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:43 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045" returned: 0 in 0.836s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:43 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 is being set with open permissions: ugo+rw Jul 08 10:54:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:43 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 Jul 08 10:54:43 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:43 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045" returned: 0 in 0.655s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:43 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.info Jul 08 10:54:43 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:44 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.info" returned: 0 in 0.653s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:44 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.info is being set with open permissions: ugo+rw Jul 08 10:54:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:44 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.info Jul 08 10:54:44 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:45 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.info" returned: 0 in 0.654s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.696s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.143s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-976329264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc1d72e-f507-4c23-b976-410ec12ef93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc271652b3a4e0298ab9a637b065944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:42Z,use_quota=True,user_id='4c81d18375224c16b2b05738d7ea5d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Creating volume 3bc1d72e-f507-4c23-b976-410ec12ef93c {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:54:45 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:54:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:45 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c 1073741824 Jul 08 10:54:45 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:45 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-90942c62-d5b4-4eb1-acbb-0e8ecb59eea3 tempest-VolumesDeleteCascade-327605379 None] Create snapshot completed successfully Jul 08 10:54:46 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c 1073741824" returned: 0 in 0.889s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:46 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c Jul 08 10:54:46 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Flow 'volume_create_manager' (ef918ede-ae3b-48f0-8fb8-2c88b821948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4dde45-1415-4080-b11b-2be190201bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4dde45-1415-4080-b11b-2be190201bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1999581647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b595017-4940-4207-bdd5-12808969ecc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766c4d2eee664d7b9113bfa6d68b6013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03a2bd83-ccda-46cd-a99d-fbf78b256045,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:54:46Z,use_quota=True,user_id='e4b75498aaf74ba981f63dff20189742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c2f93c-48b4-4b15-99d8-997c384d4253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c2f93c-48b4-4b15-99d8-997c384d4253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75b674e-6358-41b0-8ab2-781a7e6af191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75b674e-6358-41b0-8ab2-781a7e6af191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b595017-4940-4207-bdd5-12808969ecc4', 'volume_name': 'volume-3b595017-4940-4207-bdd5-12808969ecc4', 'volume_size': 1, 'snapshot_id': '03a2bd83-ccda-46cd-a99d-fbf78b256045'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6002c426-d4bc-403e-8aef-a92d0220c374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6002c426-d4bc-403e-8aef-a92d0220c374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a4568a-27a5-4b1c-a555-2ab0b6929fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:46 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Volume 3b595017-4940-4207-bdd5-12808969ecc4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b595017-4940-4207-bdd5-12808969ecc4', 'volume_size': 1, 'snapshot_id': '03a2bd83-ccda-46cd-a99d-fbf78b256045'} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:46 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c" returned: 0 in 0.716s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.429s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-quobyte-03a2bd83-ccda-46cd-a99d-fbf78b256045-3b595017-4940-4207-bdd5-12808969ecc4" by "_create_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0652a52f-530f-4546-9627-d0cd3fc9135a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc1d72e-f507-4c23-b976-410ec12ef93c', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d57b2e6-ed6f-4186-b28c-e50903b4ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-03a2bd83-ccda-46cd-a99d-fbf78b256045-3b595017-4940-4207-bdd5-12808969ecc4" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Creating volume 3b595017-4940-4207-bdd5-12808969ecc4 from snapshot 03a2bd83-ccda-46cd-a99d-fbf78b256045 {{(pid=86913) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-quobyte-3b595017-4940-4207-bdd5-12808969ecc4" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:46 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Volume volume-3bc1d72e-f507-4c23-b976-410ec12ef93c (3bc1d72e-f507-4c23-b976-410ec12ef93c): created successfully Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d57b2e6-ed6f-4186-b28c-e50903b4ac08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Flow 'volume_create_manager' (0c893293-4cfe-4d4a-917a-64f70bea444d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-3b595017-4940-4207-bdd5-12808969ecc4" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] snapshot: 03a2bd83-ccda-46cd-a99d-fbf78b256045, volume: 3b595017-4940-4207-bdd5-12808969ecc4, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 10:54:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e0e15af8-5c24-43fe-b9a8-5e0f55c8125b tempest-VolumesSnapshotTestJSON-1748779462 None] Created volume successfully. Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be3355b-f864-41d6-9aab-723328b2891a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:47 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 Jul 08 10:54:47 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:47 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045" returned: 0 in 0.821s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:54:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 10:54:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 10:54:47 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2556d3-f2fc-4c47-b575-459a719aa6fe]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:47 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 Jul 08 10:54:47 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:48 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" returned: 0 in 0.803s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:48 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4 not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 10:54:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:48 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4 Jul 08 10:54:48 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:53 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4" returned: 0 in 4.884s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:53 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb815391-cae7-479c-8f7d-1b8a19b20b22]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:53 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 Jul 08 10:54:53 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:54:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:54:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:54:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:54:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:53 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:54:53 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:54 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" returned: 0 in 0.941s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:54 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:54:54 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Converted 1024.00 MB image at 209.60 MB/s Jul 08 10:54:54 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4 is being set with open permissions: ugo+rw Jul 08 10:54:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:54 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4 Jul 08 10:54:54 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:54 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.705s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:54:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:54:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:54:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:54:55 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4" returned: 0 in 0.646s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-3b595017-4940-4207-bdd5-12808969ecc4" released by "_copy_volume_from_snapshot" :: held 8.205s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-03a2bd83-ccda-46cd-a99d-fbf78b256045-3b595017-4940-4207-bdd5-12808969ecc4" released by "_create_volume_from_snapshot" :: held 8.254s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.286s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.756s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] Creating offline snapshot 2d568bd7-54bb-4804-8822-c7b57569f432 of volume 3bc1d72e-f507-4c23-b976-410ec12ef93c {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a4568a-27a5-4b1c-a555-2ab0b6929fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b595017-4940-4207-bdd5-12808969ecc4', 'volume_size': 1, 'snapshot_id': '03a2bd83-ccda-46cd-a99d-fbf78b256045'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5403a6-efcf-4002-adc7-75ba938cec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[316deaea-e7b3-408d-927c-0f4ba27f0713]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:55 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Volume volume-3b595017-4940-4207-bdd5-12808969ecc4 (3b595017-4940-4207-bdd5-12808969ecc4): created successfully Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5403a6-efcf-4002-adc7-75ba938cec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Flow 'volume_create_manager' (ef918ede-ae3b-48f0-8fb8-2c88b821948e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:54:55 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-948a6aaa-1cde-4138-a25d-d49a7d64fee8 tempest-VolumesDeleteCascade-327605379 None] Created volume successfully. Jul 08 10:54:55 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c Jul 08 10:54:55 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:55 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c" returned: 0 in 0.790s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:55 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 1G Jul 08 10:54:55 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-8aaa8b44-88b9-42a4-b15b-61a6443c18f9-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-8aaa8b44-88b9-42a4-b15b-61a6443c18f9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Performing cascade delete. {{(pid=86913) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-03a2bd83-ccda-46cd-a99d-fbf78b256045-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-03a2bd83-ccda-46cd-a99d-fbf78b256045-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-quobyte-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-quobyte-03a2bd83-ccda-46cd-a99d-fbf78b256045" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-03a2bd83-ccda-46cd-a99d-fbf78b256045" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Deleting offline snapshot 03a2bd83-ccda-46cd-a99d-fbf78b256045 of volume 8aaa8b44-88b9-42a4-b15b-61a6443c18f9 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] snapshot_file for this snap is: volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[04636370-0b39-4bee-afdd-234a7a53481a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:56 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 Jul 08 10:54:56 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:56 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 1G" returned: 0 in 0.821s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc1d72e-f507-4c23-b976-410ec12ef93c -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:56 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc1d72e-f507-4c23-b976-410ec12ef93c -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 Jul 08 10:54:56 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:57 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045" returned: 0 in 0.831s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:54:57 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95a3e52-709f-4d18-bec1-3d6ded9e074a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:57 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 Jul 08 10:54:57 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:57 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc1d72e-f507-4c23-b976-410ec12ef93c -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432" returned: 0 in 0.805s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:57 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 is being set with open permissions: ugo+rw Jul 08 10:54:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:57 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 Jul 08 10:54:57 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:58 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" returned: 0 in 0.841s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:58 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 Jul 08 10:54:58 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:58 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432" returned: 0 in 0.730s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:58 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.info Jul 08 10:54:58 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:58 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045" returned: 0 in 0.840s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:58 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045 Jul 08 10:54:58 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:59 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.info" returned: 0 in 0.688s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:59 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.info is being set with open permissions: ugo+rw Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:54:59 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.info Jul 08 10:54:59 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:54:59 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9.03a2bd83-ccda-46cd-a99d-fbf78b256045" returned: 0 in 0.745s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-03a2bd83-ccda-46cd-a99d-fbf78b256045" released by "_delete_snapshot" :: held 3.364s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" released by "delete_snapshot" :: held 3.393s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:59 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.info" returned: 0 in 0.689s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.645s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:54:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9fb35bb2-803a-4452-a894-33479def4ae4 tempest-VolumesSnapshotTestJSON-1748779462 None] Create snapshot completed successfully Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Created reservations ['510ff15e-3d3a-474a-86a7-ad9f4798d0e5', '5d403e94-33b9-4987-8029-b266b2b485e8', '22d1cda5-7170-41b4-8de7-472f2c076777', 'ac18a4ad-619b-42c3-adf1-fb70eae06df7'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:54:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Delete snapshot completed successfully. Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-03a2bd83-ccda-46cd-a99d-fbf78b256045-delete_snapshot" released by "delete_snapshot" :: held 3.584s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Snapshots deleted, issuing volume delete {{(pid=86913) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-quobyte-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc8e4d7-3eab-42eb-b0df-0137aaaa023a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:54:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:00 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 Jul 08 10:55:00 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Flow 'volume_create_manager' (0627eaa2-7103-4cba-b7d4-d1ea80932c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b37164-a73c-43c1-988b-ac07a3dfac59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:00 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b37164-a73c-43c1-988b-ac07a3dfac59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-9570498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ffddb5-f9b9-4325-bde2-16ca6110bd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc271652b3a4e0298ab9a637b065944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2d568bd7-54bb-4804-8822-c7b57569f432,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:01Z,use_quota=True,user_id='4c81d18375224c16b2b05738d7ea5d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f0b945-58cc-4c79-8ede-bc42833f38cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f0b945-58cc-4c79-8ede-bc42833f38cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671d41b4-10b1-45e6-bee4-f8670556479b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671d41b4-10b1-45e6-bee4-f8670556479b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39ffddb5-f9b9-4325-bde2-16ca6110bd76', 'volume_name': 'volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76', 'volume_size': 2, 'snapshot_id': '2d568bd7-54bb-4804-8822-c7b57569f432'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b19df5e-123b-4de4-9a87-b5109cd34247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b19df5e-123b-4de4-9a87-b5109cd34247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b939dea2-ffe2-424e-886e-bd11dd5fc8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:00 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Volume 39ffddb5-f9b9-4325-bde2-16ca6110bd76: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76', 'volume_size': 2, 'snapshot_id': '2d568bd7-54bb-4804-8822-c7b57569f432'} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" returned: 0 in 0.916s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:00 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9 Jul 08 10:55:00 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-2d568bd7-54bb-4804-8822-c7b57569f432-39ffddb5-f9b9-4325-bde2-16ca6110bd76" by "_create_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-2d568bd7-54bb-4804-8822-c7b57569f432-39ffddb5-f9b9-4325-bde2-16ca6110bd76" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Creating volume 39ffddb5-f9b9-4325-bde2-16ca6110bd76 from snapshot 2d568bd7-54bb-4804-8822-c7b57569f432 {{(pid=86913) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-39ffddb5-f9b9-4325-bde2-16ca6110bd76" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-39ffddb5-f9b9-4325-bde2-16ca6110bd76" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] snapshot: 2d568bd7-54bb-4804-8822-c7b57569f432, volume: 39ffddb5-f9b9-4325-bde2-16ca6110bd76, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61cc831-e7a2-402e-b98f-a6062d34eaf1]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:01 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 Jul 08 10:55:01 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:01 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" returned: 0 in 0.696s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-8aaa8b44-88b9-42a4-b15b-61a6443c18f9" released by "delete_volume" :: held 1.693s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Created reservations ['f24d26c7-cf6e-4041-aec9-39c7427ec223', '307cc35d-a567-46b1-8950-9bf656e163f5', 'c01d13bc-9b37-4a7b-ab06-cecc92db7300', '00ba3a00-f8a7-43dc-907a-1f0a74be0b22'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:01 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:01 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:01 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432" returned: 0 in 0.833s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc1d72e-f507-4c23-b976-410ec12ef93c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeb845a-94cc-4f54-b666-ec1625c94575]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:01 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c Jul 08 10:55:01 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:02 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.742s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:02 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Deleted volume successfully. Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a3d6fcbc-a502-4251-917a-07b41dd9d301 tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-8aaa8b44-88b9-42a4-b15b-61a6443c18f9-delete_volume" released by "delete_volume" :: held 6.265s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:02 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c" returned: 0 in 0.861s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:02 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 Jul 08 10:55:02 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-3b595017-4940-4207-bdd5-12808969ecc4-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-3b595017-4940-4207-bdd5-12808969ecc4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "cinder-quobyte-3b595017-4940-4207-bdd5-12808969ecc4" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-3b595017-4940-4207-bdd5-12808969ecc4" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f848931-a5b4-47d6-866c-12b054f11637]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:03 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4 Jul 08 10:55:03 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:04 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4" returned: 0 in 1.425s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:04 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4 Jul 08 10:55:04 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:06 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3b595017-4940-4207-bdd5-12808969ecc4" returned: 0 in 1.680s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-quobyte-3b595017-4940-4207-bdd5-12808969ecc4" released by "delete_volume" :: held 3.177s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:06 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Created reservations ['10edeb0e-4200-4599-b97c-c81c8bafcc4b', 'f3cd8158-f05c-4113-bdfe-c188d791f9e5', '862a160f-fac6-425a-aa54-efac750befe9', '999e7804-7cb0-4c5d-850a-423c8c0e77e7'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:06 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:06 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:08 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76" returned: 0 in 5.346s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:08 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab7f544-0c6e-478a-b56f-cd5f87f08dca]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:08 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.728s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:08 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:08 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Deleted volume successfully. Jul 08 10:55:08 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c Jul 08 10:55:08 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6589eb98-3479-4866-9b67-d041e2e5656b tempest-VolumesDeleteCascade-327605379 None] Lock "cinder-3b595017-4940-4207-bdd5-12808969ecc4-delete_volume" released by "delete_volume" :: held 5.345s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:09 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c" returned: 0 in 1.050s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:09 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:55:09 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Converted 1024.00 MB image at 191.50 MB/s Jul 08 10:55:09 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 is being set with open permissions: ugo+rw Jul 08 10:55:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:09 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 Jul 08 10:55:09 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:09 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76" returned: 0 in 0.641s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-39ffddb5-f9b9-4325-bde2-16ca6110bd76" released by "_copy_volume_from_snapshot" :: held 8.842s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-2d568bd7-54bb-4804-8822-c7b57569f432-39ffddb5-f9b9-4325-bde2-16ca6110bd76" released by "_create_volume_from_snapshot" :: held 8.879s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.896s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b939dea2-ffe2-424e-886e-bd11dd5fc8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76', 'volume_size': 2, 'snapshot_id': '2d568bd7-54bb-4804-8822-c7b57569f432'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33875333-4781-4f14-b750-251ff9a74f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:09 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Volume volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 (39ffddb5-f9b9-4325-bde2-16ca6110bd76): created successfully Jul 08 10:55:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33875333-4781-4f14-b750-251ff9a74f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Flow 'volume_create_manager' (0627eaa2-7103-4cba-b7d4-d1ea80932c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9fa3b739-a5c2-4e27-b7a5-f209e27f997d tempest-VolumesSnapshotTestJSON-1748779462 None] Created volume successfully. Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-39ffddb5-f9b9-4325-bde2-16ca6110bd76-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-39ffddb5-f9b9-4325-bde2-16ca6110bd76-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-39ffddb5-f9b9-4325-bde2-16ca6110bd76" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-39ffddb5-f9b9-4325-bde2-16ca6110bd76" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08acd39-43a8-40e5-8bd3-64494edba48d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Flow 'volume_create_manager' (a3960c86-97aa-403b-a85d-701793ae2356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef12e620-4642-4c4d-8b33-04f3a2cd7755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef12e620-4642-4c4d-8b33-04f3a2cd7755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1547139484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c1a4e2-fd0a-4a62-8b55-62abc4d79254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ce1778567143bbb2d01aa8c4563756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:11Z,use_quota=True,user_id='e06013e76b7b42e98f1220e66e3e2699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eefd8b8-7b29-4add-b312-7e1d1ed1147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eefd8b8-7b29-4add-b312-7e1d1ed1147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1a8703-87a6-4adb-bc3f-50531cd089ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:10 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1a8703-87a6-4adb-bc3f-50531cd089ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c1a4e2-fd0a-4a62-8b55-62abc4d79254', 'volume_name': 'volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:10 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67988af-10f2-4920-8f9d-c4b23d5c3d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67988af-10f2-4920-8f9d-c4b23d5c3d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000aeae3-e76d-433b-be59-815ee4559150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:10 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Volume d5c1a4e2-fd0a-4a62-8b55-62abc4d79254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254', 'volume_size': 1} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1547139484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c1a4e2-fd0a-4a62-8b55-62abc4d79254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ce1778567143bbb2d01aa8c4563756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:11Z,use_quota=True,user_id='e06013e76b7b42e98f1220e66e3e2699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Creating volume d5c1a4e2-fd0a-4a62-8b55-62abc4d79254 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:55:10 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:55:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:10 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254 1073741824 Jul 08 10:55:10 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:11 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76" returned: 0 in 0.870s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:11 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76 Jul 08 10:55:11 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:11 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254 1073741824" returned: 0 in 0.840s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:11 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254 Jul 08 10:55:11 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:12 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-39ffddb5-f9b9-4325-bde2-16ca6110bd76" returned: 0 in 0.679s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-39ffddb5-f9b9-4325-bde2-16ca6110bd76" released by "delete_volume" :: held 1.593s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Created reservations ['6bc98d86-4ff7-45c4-b17a-4db007b180cb', '0ba23ecc-1846-44e5-a354-96312975ff96', 'c11ab1d1-7f07-4d5a-bab3-5501682a1dd1', '92454f6c-c0a6-438e-88fa-d44c1af28605'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:12 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254" returned: 0 in 0.678s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:12 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:12 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000aeae3-e76d-433b-be59-815ee4559150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f332774-5d98-4200-aead-d4345680993a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:12 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Volume volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254 (d5c1a4e2-fd0a-4a62-8b55-62abc4d79254): created successfully Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f332774-5d98-4200-aead-d4345680993a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Flow 'volume_create_manager' (a3960c86-97aa-403b-a85d-701793ae2356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:12 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2853da60-3703-49e1-8fc6-0a9958ba64da tempest-VolumesMetadataTest-1377284527 None] Created volume successfully. Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-2d568bd7-54bb-4804-8822-c7b57569f432-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-2d568bd7-54bb-4804-8822-c7b57569f432-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-3bc1d72e-f507-4c23-b976-410ec12ef93c" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-3bc1d72e-f507-4c23-b976-410ec12ef93c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-2d568bd7-54bb-4804-8822-c7b57569f432" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-2d568bd7-54bb-4804-8822-c7b57569f432" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Deleting offline snapshot 2d568bd7-54bb-4804-8822-c7b57569f432 of volume 3bc1d72e-f507-4c23-b976-410ec12ef93c {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] snapshot_file for this snap is: volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f88c24f-e9dd-4968-a81b-a083893f3f4f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:12 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.714s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:12 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:12 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Deleted volume successfully. Jul 08 10:55:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ac7d0689-9902-4423-add5-483e1d95ec33 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-39ffddb5-f9b9-4325-bde2-16ca6110bd76-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:13 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 Jul 08 10:55:13 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Acquiring lock "cinder-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Lock "cinder-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Acquiring lock "cinder-quobyte-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Lock "cinder-quobyte-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254" acquired by "delete_volume" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:13 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5b8419-e949-4efd-9e3d-7a06326af28a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:13 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254 Jul 08 10:55:13 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:13 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432" returned: 0 in 0.847s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc1d72e-f507-4c23-b976-410ec12ef93c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:55:13 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1deb8d-6533-4734-b97c-16a4a9e9db41]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:13 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c Jul 08 10:55:13 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:14 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254" returned: 0 in 0.779s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:14 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254 Jul 08 10:55:14 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:14 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c" returned: 0 in 0.856s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:14 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 Jul 08 10:55:14 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:15 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254" returned: 0 in 0.654s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Lock "cinder-quobyte-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254" released by "delete_volume" :: held 1.476s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Created reservations ['dc40a7c4-6c33-40d6-9e5d-1aeed20d7ada', '21a8dc31-077b-45eb-a572-27ceee655c5c', 'd32d5daa-0e13-4383-8bab-3582b561518b', 'be251109-61c8-4682-b0e3-6f54c6644044'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:15 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:15 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:15 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432" returned: 0 in 0.767s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:15 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432 Jul 08 10:55:15 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:15 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.680s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:15 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Deleted volume successfully. Jul 08 10:55:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dbef0a8a-6c45-4cf7-8a96-61f879f24cc7 tempest-VolumesMetadataTest-1377284527 None] Lock "cinder-d5c1a4e2-fd0a-4a62-8b55-62abc4d79254-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:16 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c.2d568bd7-54bb-4804-8822-c7b57569f432" returned: 0 in 0.733s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-2d568bd7-54bb-4804-8822-c7b57569f432" released by "_delete_snapshot" :: held 3.324s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-3bc1d72e-f507-4c23-b976-410ec12ef93c" released by "delete_snapshot" :: held 3.348s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:16 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Created reservations ['878f5e44-db0e-402a-93c1-eba502473231', '7be9f3a7-9823-4d20-8812-546679395c94', '6c870f4f-746b-488f-a3b5-5bd07f6b7a56', '76721b1c-b2f8-4609-8d72-947830940d5f'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:16 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Delete snapshot completed successfully. Jul 08 10:55:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ed02a66-7b88-4e1c-9f4e-32ce34cfdb6a tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-2d568bd7-54bb-4804-8822-c7b57569f432-delete_snapshot" released by "delete_snapshot" :: held 3.502s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-3bc1d72e-f507-4c23-b976-410ec12ef93c-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-3bc1d72e-f507-4c23-b976-410ec12ef93c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-3bc1d72e-f507-4c23-b976-410ec12ef93c" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-3bc1d72e-f507-4c23-b976-410ec12ef93c" acquired by "delete_volume" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:17 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[918bfefd-fefa-4a03-9f3f-37ff29a5efbc]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:17 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c Jul 08 10:55:17 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:17 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c" returned: 0 in 0.751s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:18 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c Jul 08 10:55:18 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:18 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3bc1d72e-f507-4c23-b976-410ec12ef93c" returned: 0 in 0.648s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-3bc1d72e-f507-4c23-b976-410ec12ef93c" released by "delete_volume" :: held 1.468s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:18 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Created reservations ['cccc6eb8-9236-4069-96be-7f883b9aa69d', 'c0dd7669-e877-4934-b095-3a4aba0c705a', '12f983e7-17be-4bac-b2e6-3865787bd057', 'c89f4440-4fd1-4e4b-befb-179390fa98b1'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:18 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:18 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:19 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.699s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:19 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:19 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Deleted volume successfully. Jul 08 10:55:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-6e1bf86c-e5ec-4792-aab7-f7ce504f63c3 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-3bc1d72e-f507-4c23-b976-410ec12ef93c-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:19 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Flow 'volume_create_manager' (17fbb7a4-450b-4fc2-a6c5-2789fb111bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227b086c-48f5-4f8d-994b-0a78c6beef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227b086c-48f5-4f8d-994b-0a78c6beef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1451586228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b7ca00-acec-44a8-b54d-f9f0b310ce90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc271652b3a4e0298ab9a637b065944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:20Z,use_quota=True,user_id='4c81d18375224c16b2b05738d7ea5d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f1e70c-d62f-49c3-9ee6-1a0ee4e69d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f1e70c-d62f-49c3-9ee6-1a0ee4e69d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb9b1ef-6351-46c6-87b0-6b6942bde284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb9b1ef-6351-46c6-87b0-6b6942bde284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2b7ca00-acec-44a8-b54d-f9f0b310ce90', 'volume_name': 'volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee2962b-ea1e-4923-ab5c-f67fda044098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee2962b-ea1e-4923-ab5c-f67fda044098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d46a762-a039-4a62-b516-bb1561abb4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:20 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Volume a2b7ca00-acec-44a8-b54d-f9f0b310ce90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90', 'volume_size': 1} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1451586228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b7ca00-acec-44a8-b54d-f9f0b310ce90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc271652b3a4e0298ab9a637b065944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:20Z,use_quota=True,user_id='4c81d18375224c16b2b05738d7ea5d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Creating volume a2b7ca00-acec-44a8-b54d-f9f0b310ce90 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:55:20 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:20 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 1073741824 Jul 08 10:55:20 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Flow 'volume_create_manager' (f2a14d27-118a-439c-b790-641fedc56dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae13927e-b126-42a9-8516-39c47403b88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae13927e-b126-42a9-8516-39c47403b88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-672676164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ae1453-45e7-4466-898a-9e34a31f95f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50272f2d5214be4a969c949b6dc9208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:20Z,use_quota=True,user_id='6f1d4f5f74c14d7a84e01187204e96f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ebae5f-521e-4163-9730-fc571b924df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ebae5f-521e-4163-9730-fc571b924df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba887f07-786c-45c3-9bb3-a56ec7d70e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba887f07-786c-45c3-9bb3-a56ec7d70e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ae1453-45e7-4466-898a-9e34a31f95f9', 'volume_name': 'volume-b3ae1453-45e7-4466-898a-9e34a31f95f9', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a3df5e-cef2-4b7d-967a-517268d72687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a3df5e-cef2-4b7d-967a-517268d72687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2b01bb-9460-416a-ad7b-d761c4c1e022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:20 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Volume b3ae1453-45e7-4466-898a-9e34a31f95f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ae1453-45e7-4466-898a-9e34a31f95f9', 'volume_size': 1} Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:20 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 1073741824" returned: 0 in 0.915s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:21 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 Jul 08 10:55:21 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:21 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" returned: 0 in 0.658s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.370s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-672676164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ae1453-45e7-4466-898a-9e34a31f95f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50272f2d5214be4a969c949b6dc9208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:20Z,use_quota=True,user_id='6f1d4f5f74c14d7a84e01187204e96f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Creating volume b3ae1453-45e7-4466-898a-9e34a31f95f9 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:55:21 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:21 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9 1073741824 Jul 08 10:55:21 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d46a762-a039-4a62-b516-bb1561abb4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef384ea7-b33f-4b6f-8543-86744ad06b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:21 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Volume volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 (a2b7ca00-acec-44a8-b54d-f9f0b310ce90): created successfully Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef384ea7-b33f-4b6f-8543-86744ad06b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:21 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Flow 'volume_create_manager' (17fbb7a4-450b-4fc2-a6c5-2789fb111bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:21 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f995aaaf-fef6-4c55-a727-41abda58bfb3 tempest-VolumesSnapshotTestJSON-1748779462 None] Created volume successfully. Jul 08 10:55:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:22 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9 1073741824" returned: 0 in 0.867s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:22 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9 Jul 08 10:55:22 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:23 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9" returned: 0 in 0.649s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:55:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.057s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2b01bb-9460-416a-ad7b-d761c4c1e022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ae1453-45e7-4466-898a-9e34a31f95f9', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040252a7-5d47-491b-8322-af17cd74b324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] Creating offline snapshot 77eccc3b-4f3c-4b09-8069-e991b8c0dd12 of volume a2b7ca00-acec-44a8-b54d-f9f0b310ce90 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 10:55:23 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Volume volume-b3ae1453-45e7-4466-898a-9e34a31f95f9 (b3ae1453-45e7-4466-898a-9e34a31f95f9): created successfully Jul 08 10:55:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040252a7-5d47-491b-8322-af17cd74b324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Flow 'volume_create_manager' (f2a14d27-118a-439c-b790-641fedc56dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:23 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb79637c-edfd-469e-bf1a-341ab0d006e0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:23 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e3460c53-f5a3-47ac-8a5f-801101fd6558 tempest-VolumesTransfersTest-191999925 None] Created volume successfully. Jul 08 10:55:23 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 Jul 08 10:55:23 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:24 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" returned: 0 in 0.761s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:24 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 1G Jul 08 10:55:24 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:24 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 1G" returned: 0 in 0.890s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:24 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 Jul 08 10:55:24 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-804de160-d8eb-41b5-ad09-9b6b81e1fbb0 tempest-VolumesTransfersTest-2020049244 None] Transfer volume completed successfully. Jul 08 10:55:24 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:25 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12" returned: 0 in 0.755s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:25 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 is being set with open permissions: ugo+rw Jul 08 10:55:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:25 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 Jul 08 10:55:25 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Acquiring lock "cinder-b3ae1453-45e7-4466-898a-9e34a31f95f9-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Lock "cinder-b3ae1453-45e7-4466-898a-9e34a31f95f9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Acquiring lock "cinder-quobyte-b3ae1453-45e7-4466-898a-9e34a31f95f9" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Lock "cinder-quobyte-b3ae1453-45e7-4466-898a-9e34a31f95f9" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:26 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a442bf-ae7f-41a4-8ccb-c27d746c7ff2]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:26 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9 Jul 08 10:55:26 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:26 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12" returned: 0 in 0.703s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:26 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.info Jul 08 10:55:26 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:26 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9" returned: 0 in 0.902s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:27 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9 Jul 08 10:55:27 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:27 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.info" returned: 0 in 0.711s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:27 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.info is being set with open permissions: ugo+rw Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:27 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.info Jul 08 10:55:27 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:27 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b3ae1453-45e7-4466-898a-9e34a31f95f9" returned: 0 in 0.761s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Lock "cinder-quobyte-b3ae1453-45e7-4466-898a-9e34a31f95f9" released by "delete_volume" :: held 1.713s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=135,cinder:SELECT=100,cinder:DELETE=9,cinder:INSERT=38 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Created reservations ['1023d0ee-bc59-416b-bcf4-8e8e68ed45ef', 'ad9884cf-d05d-4ead-8939-83fc982a5478', 'ac9ab3a2-5bcc-454c-a023-8f3bd4856934', '58e44ed4-a6ee-4e8c-9ab5-d5a4c390019a'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:27 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.info" returned: 0 in 0.703s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.637s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-cd06e296-49cb-42c1-a25d-a13d3054d1de tempest-VolumesSnapshotTestJSON-1748779462 None] Create snapshot completed successfully Jul 08 10:55:27 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:27 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:28 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.769s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:28 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Deleted volume successfully. Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-00129f5b-185d-453c-8f3a-9632cb5f9eba tempest-VolumesTransfersTest-979429499 None] Lock "cinder-b3ae1453-45e7-4466-898a-9e34a31f95f9-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Flow 'volume_create_manager' (0879df63-d205-44c2-912e-8dd1e4616ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b8c639-45cd-4597-b0bb-ce955a7e402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b8c639-45cd-4597-b0bb-ce955a7e402e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-271552976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b94682-4ca9-4c91-913e-8a292e83d053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50272f2d5214be4a969c949b6dc9208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:29Z,use_quota=True,user_id='6f1d4f5f74c14d7a84e01187204e96f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b96bc5-3efe-47b2-b1b5-c2f9e4a53f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b96bc5-3efe-47b2-b1b5-c2f9e4a53f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fdfbf2-45a6-4568-9a94-b4f34beda2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fdfbf2-45a6-4568-9a94-b4f34beda2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0b94682-4ca9-4c91-913e-8a292e83d053', 'volume_name': 'volume-f0b94682-4ca9-4c91-913e-8a292e83d053', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d276351-1e10-4983-a6f0-0ffdbfda19d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d276351-1e10-4983-a6f0-0ffdbfda19d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c086e3d5-957e-4402-86ed-d862965666b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:28 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Volume f0b94682-4ca9-4c91-913e-8a292e83d053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0b94682-4ca9-4c91-913e-8a292e83d053', 'volume_size': 1} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-271552976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b94682-4ca9-4c91-913e-8a292e83d053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50272f2d5214be4a969c949b6dc9208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:29Z,use_quota=True,user_id='6f1d4f5f74c14d7a84e01187204e96f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Creating volume f0b94682-4ca9-4c91-913e-8a292e83d053 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:55:28 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:55:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:28 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053 1073741824 Jul 08 10:55:28 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Flow 'volume_create_manager' (de482385-991d-4f8c-9fc1-4fd82d1867ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be412481-067f-483a-a94c-6943ae7970b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be412481-067f-483a-a94c-6943ae7970b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1667687658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabc2e59-b33c-43a0-a04f-4a7b84db6ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc271652b3a4e0298ab9a637b065944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=77eccc3b-4f3c-4b09-8069-e991b8c0dd12,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:29Z,use_quota=True,user_id='4c81d18375224c16b2b05738d7ea5d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d584f41a-dd33-4274-be88-31cb56dc3f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d584f41a-dd33-4274-be88-31cb56dc3f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12de099-ed8b-42b7-910a-aeaf8638e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12de099-ed8b-42b7-910a-aeaf8638e097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cabc2e59-b33c-43a0-a04f-4a7b84db6ba6', 'volume_name': 'volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6', 'volume_size': 1, 'snapshot_id': '77eccc3b-4f3c-4b09-8069-e991b8c0dd12'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c41fcf-e868-4ccc-8d80-aff1727ddf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c41fcf-e868-4ccc-8d80-aff1727ddf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b749790b-5e5d-443c-a601-27d35bfe4fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:29 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Volume cabc2e59-b33c-43a0-a04f-4a7b84db6ba6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6', 'volume_size': 1, 'snapshot_id': '77eccc3b-4f3c-4b09-8069-e991b8c0dd12'} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:29 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053 1073741824" returned: 0 in 0.927s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:29 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053 Jul 08 10:55:29 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:30 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053" returned: 0 in 0.686s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.360s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-77eccc3b-4f3c-4b09-8069-e991b8c0dd12-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" by "_create_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-77eccc3b-4f3c-4b09-8069-e991b8c0dd12-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Creating volume cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 from snapshot 77eccc3b-4f3c-4b09-8069-e991b8c0dd12 {{(pid=86913) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c086e3d5-957e-4402-86ed-d862965666b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b94682-4ca9-4c91-913e-8a292e83d053', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6c9082-f39f-46fe-b79b-71daa509c508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] snapshot: 77eccc3b-4f3c-4b09-8069-e991b8c0dd12, volume: cabc2e59-b33c-43a0-a04f-4a7b84db6ba6, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 10:55:30 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Volume volume-f0b94682-4ca9-4c91-913e-8a292e83d053 (f0b94682-4ca9-4c91-913e-8a292e83d053): created successfully Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6c9082-f39f-46fe-b79b-71daa509c508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Flow 'volume_create_manager' (0879df63-d205-44c2-912e-8dd1e4616ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:30 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-172ef5dd-1736-4379-b422-60d2619486de tempest-VolumesTransfersTest-191999925 None] Created volume successfully. Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5892d4fe-b539-4257-abc6-15f608811708]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:30 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 Jul 08 10:55:30 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Acquiring lock "cinder-f0b94682-4ca9-4c91-913e-8a292e83d053-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Lock "cinder-f0b94682-4ca9-4c91-913e-8a292e83d053-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Acquiring lock "cinder-quobyte-f0b94682-4ca9-4c91-913e-8a292e83d053" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Lock "cinder-quobyte-f0b94682-4ca9-4c91-913e-8a292e83d053" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4ad7c6-884b-4d0c-ada4-441bf72f05e0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:31 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053 Jul 08 10:55:31 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:31 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12" returned: 0 in 0.813s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7720d82-ce7b-48d0-96fe-05c4d40bd1ce]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:31 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 Jul 08 10:55:31 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:32 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053" returned: 0 in 0.861s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:32 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053 Jul 08 10:55:32 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:32 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" returned: 0 in 0.776s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:32 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 Jul 08 10:55:32 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:32 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0b94682-4ca9-4c91-913e-8a292e83d053" returned: 0 in 0.655s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Lock "cinder-quobyte-f0b94682-4ca9-4c91-913e-8a292e83d053" released by "delete_volume" :: held 1.568s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=107,cinder:INSERT=26,cinder:UPDATE=103,cinder:DELETE=13 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Created reservations ['bf4aa785-e5eb-4e2e-a7c0-ce03577ab23e', '0fadfc8c-0763-4ff4-9134-f4023c40dea1', '9923f361-ed6c-437b-94fd-b4e975ea29a4', 'd4a7c23c-9ca5-4a87-b50d-da19ea5ec155'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:33 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:33 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:34 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.124s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:34 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:34 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Deleted volume successfully. Jul 08 10:55:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9ec77d16-f1ff-4aaa-b93b-73a77ad77ff5 tempest-VolumesTransfersTest-979429499 None] Lock "cinder-f0b94682-4ca9-4c91-913e-8a292e83d053-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:37 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" returned: 0 in 5.617s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:37 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cece54-2ded-49c3-a9ca-42ee04544f05]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:38 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 Jul 08 10:55:38 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:39 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" returned: 0 in 1.066s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:39 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:55:39 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Converted 1024.00 MB image at 182.28 MB/s Jul 08 10:55:39 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 is being set with open permissions: ugo+rw Jul 08 10:55:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:39 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 Jul 08 10:55:39 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:39 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" returned: 0 in 0.757s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" released by "_copy_volume_from_snapshot" :: held 9.161s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-77eccc3b-4f3c-4b09-8069-e991b8c0dd12-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" released by "_create_volume_from_snapshot" :: held 9.206s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.227s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b749790b-5e5d-443c-a601-27d35bfe4fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6', 'volume_size': 1, 'snapshot_id': '77eccc3b-4f3c-4b09-8069-e991b8c0dd12'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6098b432-ddfa-4edf-860e-efbae6c9df1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:39 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Volume volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 (cabc2e59-b33c-43a0-a04f-4a7b84db6ba6): created successfully Jul 08 10:55:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6098b432-ddfa-4edf-860e-efbae6c9df1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Flow 'volume_create_manager' (de482385-991d-4f8c-9fc1-4fd82d1867ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d4822419-618c-4391-822b-ab3358a0872b tempest-VolumesSnapshotTestJSON-1748779462 None] Created volume successfully. Jul 08 10:55:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" acquired by "delete_volume" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:40 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e9028d-4dd1-475b-aeee-36d88512595b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:40 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 Jul 08 10:55:40 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:41 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" returned: 0 in 0.806s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:41 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6 Jul 08 10:55:41 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Flow 'volume_create_manager' (8305eb2e-53dc-4b0d-bb7a-1b5d9d592291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e10b60-7a3a-4ddb-958a-9a436b0c1f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e10b60-7a3a-4ddb-958a-9a436b0c1f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1626718988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59adc118-de36-45e4-8af2-9bf740bbd613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb474294e26a4d678085f7455bde28f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:42Z,use_quota=True,user_id='f6cba200546543198a42ca018c6e6c6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a37838e-7269-4a4c-a4e8-ee95789d2fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a37838e-7269-4a4c-a4e8-ee95789d2fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ce484a-10ea-4017-8abf-809fcb74c103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ce484a-10ea-4017-8abf-809fcb74c103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59adc118-de36-45e4-8af2-9bf740bbd613', 'volume_name': 'volume-59adc118-de36-45e4-8af2-9bf740bbd613', 'volume_size': 2}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7a8ad7-01aa-475e-b186-21b4a5698179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7a8ad7-01aa-475e-b186-21b4a5698179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13480eb4-ff2f-4ae4-a097-18f28cfa76a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:41 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Volume 59adc118-de36-45e4-8af2-9bf740bbd613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59adc118-de36-45e4-8af2-9bf740bbd613', 'volume_size': 2} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1626718988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59adc118-de36-45e4-8af2-9bf740bbd613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb474294e26a4d678085f7455bde28f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:55:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:55:42Z,use_quota=True,user_id='f6cba200546543198a42ca018c6e6c6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Creating volume 59adc118-de36-45e4-8af2-9bf740bbd613 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:55:41 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613 2147483648 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:41 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613 2147483648 Jul 08 10:55:41 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:41 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" returned: 0 in 0.695s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6" released by "delete_volume" :: held 1.548s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Created reservations ['b8a959e6-9f50-4753-8c06-b3260cd12834', 'f5ced0da-5756-4306-ab8c-8b2e2a3a0632', '8fe0dffe-ed6f-42a0-8612-b61feb5a0518', '00b43225-ebcf-4dfe-b2c1-885ff094c766'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:41 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:41 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-77eccc3b-4f3c-4b09-8069-e991b8c0dd12-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-77eccc3b-4f3c-4b09-8069-e991b8c0dd12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-77eccc3b-4f3c-4b09-8069-e991b8c0dd12" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-77eccc3b-4f3c-4b09-8069-e991b8c0dd12" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Deleting offline snapshot 77eccc3b-4f3c-4b09-8069-e991b8c0dd12 of volume a2b7ca00-acec-44a8-b54d-f9f0b310ce90 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] snapshot_file for this snap is: volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b098cf12-fb93-40b3-a7cf-4e5f04608b58]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:42 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.784s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:42 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Deleted volume successfully. Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7e4c4457-2c19-4413-82a5-f3e1511b6ab4 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-cabc2e59-b33c-43a0-a04f-4a7b84db6ba6-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:42 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 Jul 08 10:55:42 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:42 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613 2147483648" returned: 0 in 1.093s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:42 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613 Jul 08 10:55:42 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:43 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12" returned: 0 in 0.842s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1bc2c1-111c-4955-ac64-84640b0f809d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:43 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613" returned: 0 in 0.726s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13480eb4-ff2f-4ae4-a097-18f28cfa76a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59adc118-de36-45e4-8af2-9bf740bbd613', 'volume_size': 2}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec08146-f07d-4828-a8f9-c7c3cdf886fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:55:43 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 Jul 08 10:55:43 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:43 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Volume volume-59adc118-de36-45e4-8af2-9bf740bbd613 (59adc118-de36-45e4-8af2-9bf740bbd613): created successfully Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec08146-f07d-4828-a8f9-c7c3cdf886fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Flow 'volume_create_manager' (8305eb2e-53dc-4b0d-bb7a-1b5d9d592291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:55:43 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9a18c9ee-b2a2-455f-8405-816c10bd1d07 tempest-VolumesCloneNegativeTest-1959758994 None] Created volume successfully. Jul 08 10:55:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Acquiring lock "cinder-59adc118-de36-45e4-8af2-9bf740bbd613-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Lock "cinder-59adc118-de36-45e4-8af2-9bf740bbd613-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Acquiring lock "cinder-quobyte-59adc118-de36-45e4-8af2-9bf740bbd613" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Lock "cinder-quobyte-59adc118-de36-45e4-8af2-9bf740bbd613" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:44 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3335cc-9ede-43d5-84c8-0f6a7de05bd0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:44 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613 Jul 08 10:55:44 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:44 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" returned: 0 in 0.820s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:44 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 Jul 08 10:55:44 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:44 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613" returned: 0 in 0.828s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:44 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613 Jul 08 10:55:44 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:45 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12" returned: 0 in 0.775s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:45 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12 Jul 08 10:55:45 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:45 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-59adc118-de36-45e4-8af2-9bf740bbd613" returned: 0 in 0.715s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Lock "cinder-quobyte-59adc118-de36-45e4-8af2-9bf740bbd613" released by "delete_volume" :: held 1.587s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Created reservations ['c6290728-535b-43ce-b1da-8f386d9b02c5', '17fdc8cc-e160-4446-9a00-86a5845d01bf', '30480eb4-3f11-49e9-946c-f78e1b4cedc1', '19c60477-43c8-41f8-acaf-1bad9db264ab'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:45 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:45 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:45 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90.77eccc3b-4f3c-4b09-8069-e991b8c0dd12" returned: 0 in 0.700s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-77eccc3b-4f3c-4b09-8069-e991b8c0dd12" released by "_delete_snapshot" :: held 3.263s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" released by "delete_snapshot" :: held 3.299s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:45 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Created reservations ['2ab2c054-d883-4d20-8c98-4300ee1945d9', '4ad553c8-4f51-4c19-9b7f-923494bfd1cb', '3f05985b-6656-4e34-b302-ec276b2c41e9', '0bb6e54e-904c-46e2-aa7c-c229615b788f'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Delete snapshot completed successfully. Jul 08 10:55:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d32077a9-81bc-4cfd-a09d-06cfb2ff09fe tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-77eccc3b-4f3c-4b09-8069-e991b8c0dd12-delete_snapshot" released by "delete_snapshot" :: held 3.474s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:46 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.690s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:46 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Deleted volume successfully. Jul 08 10:55:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-0caae768-4786-4c10-b2cd-f8274c866b87 tempest-VolumesCloneNegativeTest-1959758994 None] Lock "cinder-59adc118-de36-45e4-8af2-9bf740bbd613-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-a2b7ca00-acec-44a8-b54d-f9f0b310ce90-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-a2b7ca00-acec-44a8-b54d-f9f0b310ce90-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:47 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b59b4f8-ca89-42ab-bd51-8ccc30da98b9]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:47 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 Jul 08 10:55:47 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:47 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" returned: 0 in 0.815s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:47 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90 Jul 08 10:55:47 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:48 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" returned: 0 in 0.712s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-a2b7ca00-acec-44a8-b54d-f9f0b310ce90" released by "delete_volume" :: held 1.612s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:48 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Created reservations ['0c46ef64-38bd-4c79-bbb6-0a690f96496a', 'ab84cbb1-b400-4ac1-a9dd-d4bcf2d926e2', 'b4a55315-8455-40de-b63b-972787f2e3f8', 'acabbb48-d8f9-48ea-91c7-79e4c144a902'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:48 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:48 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-42d6d713-3d6d-4e0a-b242-6e5da0eb1160-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-42d6d713-3d6d-4e0a-b242-6e5da0eb1160-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "cinder-quobyte-42d6d713-3d6d-4e0a-b242-6e5da0eb1160" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:55:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-42d6d713-3d6d-4e0a-b242-6e5da0eb1160" acquired by "delete_volume" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:55:49 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ba6ece-a1c4-4826-b6dd-f5eea1dc6fc5]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:55:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:49 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.738s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:49 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:49 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Deleted volume successfully. Jul 08 10:55:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-574f74b9-237c-499f-ad75-9e41f79b0567 tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-a2b7ca00-acec-44a8-b54d-f9f0b310ce90-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:49 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 Jul 08 10:55:49 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:50 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160" returned: 0 in 0.874s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:50 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160 Jul 08 10:55:50 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:50 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42d6d713-3d6d-4e0a-b242-6e5da0eb1160" returned: 0 in 0.719s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-quobyte-42d6d713-3d6d-4e0a-b242-6e5da0eb1160" released by "delete_volume" :: held 1.683s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:51 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Created reservations ['84cf26a2-9c8b-4e85-9713-5018a44180dd', '42cb9334-f606-4c23-b082-d1affdd2c097', 'aab9d4f4-441f-4ca5-a01a-979aab1b3a26', 'f9e676d8-1ff2-4f35-8171-9807db8473d5'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:55:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:51 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:51 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:51 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.723s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:51 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:51 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Deleted volume successfully. Jul 08 10:55:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ba47d60f-d733-4509-92e5-93294247959f tempest-VolumesSnapshotTestJSON-1748779462 None] Lock "cinder-42d6d713-3d6d-4e0a-b242-6e5da0eb1160-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:55:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:55:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:55:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:55:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:55:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:55:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:55:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:55:53 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:55:53 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:55:54 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 08 10:55:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.813s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:55:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:55:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:55:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:55:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:56:01 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=31,cinder:INSERT=13,cinder:UPDATE=51 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:56:01 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=61,cinder:SELECT=42,cinder:DELETE=8,cinder:INSERT=12 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Flow 'volume_create_manager' (5dd6c36a-ee41-4bc6-8637-f25b13228eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a437686-9033-42e9-a2e4-26780448dbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a437686-9033-42e9-a2e4-26780448dbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1446180543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091958c6-795f-4bb4-90f9-3a8e551c78ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e7ede4a5e423e801faf9e74f8d967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:56:18Z,use_quota=True,user_id='52c3689719234b86b45bf94378c03c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fe6c9e0-ff5e-4aab-a451-04d2f0f04890),volume_type_id=1fe6c9e0-ff5e-4aab-a451-04d2f0f04890)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d8b286-efe7-48a3-ad53-6d187be21936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d8b286-efe7-48a3-ad53-6d187be21936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250938f4-9dd8-40bb-969d-13aeead5a3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250938f4-9dd8-40bb-969d-13aeead5a3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '091958c6-795f-4bb4-90f9-3a8e551c78ca', 'volume_name': 'volume-091958c6-795f-4bb4-90f9-3a8e551c78ca', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2e99b5-e9fd-4f85-a96d-6e2b65876f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2e99b5-e9fd-4f85-a96d-6e2b65876f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157e79ee-141f-47c0-897e-7d9e03360d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:17 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Volume 091958c6-795f-4bb4-90f9-3a8e551c78ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-091958c6-795f-4bb4-90f9-3a8e551c78ca', 'volume_size': 1} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:56:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1446180543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091958c6-795f-4bb4-90f9-3a8e551c78ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e7ede4a5e423e801faf9e74f8d967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:56:18Z,use_quota=True,user_id='52c3689719234b86b45bf94378c03c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fe6c9e0-ff5e-4aab-a451-04d2f0f04890),volume_type_id=1fe6c9e0-ff5e-4aab-a451-04d2f0f04890)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Creating volume 091958c6-795f-4bb4-90f9-3a8e551c78ca {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:56:18 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:18 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca 1073741824 Jul 08 10:56:18 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Flow 'volume_create_manager' (a0ca8630-d7de-4f54-9331-1ba3ad4bfbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e0a4a6-f163-402a-b1b8-591483e9b631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e0a4a6-f163-402a-b1b8-591483e9b631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-475677391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c318fa-3e08-407f-a689-7798be7e7138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e7ede4a5e423e801faf9e74f8d967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:56:18Z,use_quota=True,user_id='52c3689719234b86b45bf94378c03c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fec9f9e3-6a2c-4fb5-99bb-ca7018c57d05),volume_type_id=fec9f9e3-6a2c-4fb5-99bb-ca7018c57d05)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6e9432-a28f-4a5a-8c0f-5a4d03b0eb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6e9432-a28f-4a5a-8c0f-5a4d03b0eb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c17924-d75c-45c9-a002-854e472a75ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c17924-d75c-45c9-a002-854e472a75ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c318fa-3e08-407f-a689-7798be7e7138', 'volume_name': 'volume-80c318fa-3e08-407f-a689-7798be7e7138', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e093d4-f4d8-4672-a203-f3de2139c31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e093d4-f4d8-4672-a203-f3de2139c31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0eeedb-af62-4880-960e-c52673d2e468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:18 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Volume 80c318fa-3e08-407f-a689-7798be7e7138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c318fa-3e08-407f-a689-7798be7e7138', 'volume_size': 1} Jul 08 10:56:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:56:19 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca 1073741824" returned: 0 in 1.304s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Flow 'volume_create_manager' (6b8a0533-9509-4bcd-bcdb-fe84deb870d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20999a48-7162-47b4-a367-380ce1f8af2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20999a48-7162-47b4-a367-380ce1f8af2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1513547884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7137c75b-24e4-443a-86de-38add353a8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e7ede4a5e423e801faf9e74f8d967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:56:19Z,use_quota=True,user_id='52c3689719234b86b45bf94378c03c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a590adc9-1de7-4f87-8494-1ba87587e99a),volume_type_id=a590adc9-1de7-4f87-8494-1ba87587e99a)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c91a46-c199-4776-9a2a-f249e8abfa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c91a46-c199-4776-9a2a-f249e8abfa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5c96c3-819b-4712-84a6-84703a91cab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.image.glance [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Creating Keystone auth plugin from conf {{(pid=86913) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 10:56:19 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca Jul 08 10:56:19 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5c96c3-819b-4712-84a6-84703a91cab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7137c75b-24e4-443a-86de-38add353a8b2', 'volume_name': 'volume-7137c75b-24e4-443a-86de-38add353a8b2', 'volume_size': 1, 'image_id': '95aafd0b-1295-4639-b771-eb667c29aed4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95aafd0b-1295-4639-b771-eb667c29aed4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--528768695', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '456e7ede4a5e423e801faf9e74f8d967', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95aafd0b-1295-4639-b771-eb667c29aed4', 'created_at': datetime.datetime(2026, 7, 8, 8, 56, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 56, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95aafd0b-1295-4639-b771-eb667c29aed4/file', 'properties': {}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30fbcc2-9a0b-4e49-a56d-9f4d9dfbffde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30fbcc2-9a0b-4e49-a56d-9f4d9dfbffde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729db9fc-4e41-4fb2-a50c-e601817e8500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:19 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Volume 7137c75b-24e4-443a-86de-38add353a8b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7137c75b-24e4-443a-86de-38add353a8b2', 'volume_size': 1, 'image_id': '95aafd0b-1295-4639-b771-eb667c29aed4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95aafd0b-1295-4639-b771-eb667c29aed4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--528768695', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '456e7ede4a5e423e801faf9e74f8d967', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95aafd0b-1295-4639-b771-eb667c29aed4', 'created_at': datetime.datetime(2026, 7, 8, 8, 56, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 56, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95aafd0b-1295-4639-b771-eb667c29aed4/file', 'properties': {}}, 'image_service': } Jul 08 10:56:19 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Trying to clone 7137c75b-24e4-443a-86de-38add353a8b2 from image 95aafd0b-1295-4639-b771-eb667c29aed4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/95aafd0b-1295-4639-b771-eb667c29aed4', 'metadata': {}}]). {{(pid=86913) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 10:56:20 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca" returned: 0 in 1.029s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] <== create_volume: return (2440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.443s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.919s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-475677391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c318fa-3e08-407f-a689-7798be7e7138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e7ede4a5e423e801faf9e74f8d967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:56:18Z,use_quota=True,user_id='52c3689719234b86b45bf94378c03c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fec9f9e3-6a2c-4fb5-99bb-ca7018c57d05),volume_type_id=fec9f9e3-6a2c-4fb5-99bb-ca7018c57d05)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Creating volume 80c318fa-3e08-407f-a689-7798be7e7138 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:56:20 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:20 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138 1073741824 Jul 08 10:56:20 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157e79ee-141f-47c0-897e-7d9e03360d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-091958c6-795f-4bb4-90f9-3a8e551c78ca', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5569fb-42b6-4584-9161-fa6015a4e2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:20 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Volume volume-091958c6-795f-4bb4-90f9-3a8e551c78ca (091958c6-795f-4bb4-90f9-3a8e551c78ca): created successfully Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5569fb-42b6-4584-9161-fa6015a4e2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Flow 'volume_create_manager' (5dd6c36a-ee41-4bc6-8637-f25b13228eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:56:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2470fc46-292b-4102-907c-c4d057a576ea tempest-TestInstancesWithCinderVolumes-1104432161 None] Created volume successfully. Jul 08 10:56:21 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138 1073741824" returned: 0 in 1.065s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:21 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138 Jul 08 10:56:21 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:22 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138" returned: 0 in 0.700s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:56:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:56:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0eeedb-af62-4880-960e-c52673d2e468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c318fa-3e08-407f-a689-7798be7e7138', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0ac1d0-d82a-4f48-95dc-7ebc73954a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:22 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Volume volume-80c318fa-3e08-407f-a689-7798be7e7138 (80c318fa-3e08-407f-a689-7798be7e7138): created successfully Jul 08 10:56:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0ac1d0-d82a-4f48-95dc-7ebc73954a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:22 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Flow 'volume_create_manager' (a0ca8630-d7de-4f54-9331-1ba3ad4bfbc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:56:22 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5ae7c372-9c90-4935-985c-739fb893d698 tempest-TestInstancesWithCinderVolumes-1104432161 None] Created volume successfully. Jul 08 10:56:23 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD, size 20.69 MB, duration 3.97 sec {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 10:56:23 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Image download 20.69 MB at 5.21 MB/s Jul 08 10:56:23 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f653e5df-8347-4814-b3b4-87e7188bb849]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:56:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:23 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD Jul 08 10:56:23 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:24 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD" returned: 0 in 0.800s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:24 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Temporary image 95aafd0b-1295-4639-b771-eb667c29aed4 is fetched for user 52c3689719234b86b45bf94378c03c65. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 10:56:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[83389738-1a2f-4a30-92bd-7d9d0cd17bb6]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:56:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:24 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD Jul 08 10:56:24 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:25 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1513547884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7137c75b-24e4-443a-86de-38add353a8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e7ede4a5e423e801faf9e74f8d967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:56:19Z,use_quota=True,user_id='52c3689719234b86b45bf94378c03c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a590adc9-1de7-4f87-8494-1ba87587e99a),volume_type_id=a590adc9-1de7-4f87-8494-1ba87587e99a)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Creating volume 7137c75b-24e4-443a-86de-38add353a8b2 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:56:25 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:56:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:25 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 1073741824 Jul 08 10:56:25 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:26 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 1073741824" returned: 0 in 1.009s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:26 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 Jul 08 10:56:26 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:27 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2" returned: 0 in 0.679s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:56:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:56:27 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Attempting download of 95aafd0b-1295-4639-b771-eb667c29aed4 ((None, [{'url': 'file:///opt/stack/data/glance/images/95aafd0b-1295-4639-b771-eb667c29aed4', 'metadata': {}}])) to volume 7137c75b-24e4-443a-86de-38add353a8b2. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 10:56:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc41f166-5613-40a4-b481-9e604e078d45]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:56:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95aafd0b-1295-4639-b771-eb667c29aed4_g4biuo5w {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:27 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95aafd0b-1295-4639-b771-eb667c29aed4_g4biuo5w Jul 08 10:56:27 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:28 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95aafd0b-1295-4639-b771-eb667c29aed4_g4biuo5w" returned: 0 in 0.775s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95aafd0b-1295-4639-b771-eb667c29aed4_g4biuo5w {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:28 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95aafd0b-1295-4639-b771-eb667c29aed4_g4biuo5w Jul 08 10:56:28 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:28 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95aafd0b-1295-4639-b771-eb667c29aed4_g4biuo5w" returned: 1 in 0.750s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95aafd0b-1295-4639-b771-eb667c29aed4_g4biuo5w' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:56:28 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbe8e0c-345a-4f17-83f3-3e7c2fc75080]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:56:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:29 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD Jul 08 10:56:29 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:29 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:29 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] 95aafd0b-1295-4639-b771-eb667c29aed4 was qcow2, converting to raw {{(pid=86913) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 10:56:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:29 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 Jul 08 10:56:29 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:31 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2" returned: 0 in 2.021s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:31 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_95aafd0b-1295-4639-b771-eb667c29aed4_g29yqcitdevstack@QuobyteHD, size 112.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:56:31 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Converted 112.00 MB image at 55.39 MB/s Jul 08 10:56:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:31 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 1G Jul 08 10:56:31 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:32 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 1G" returned: 0 in 0.786s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:32 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[323e5707-93f9-4196-b06e-797dc369f1f5]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:56:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:32 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 Jul 08 10:56:32 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:33 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2" returned: 0 in 0.852s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:33 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 Jul 08 10:56:33 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:34 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2" returned: 1 in 0.776s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:56:34 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Downloaded image 95aafd0b-1295-4639-b771-eb667c29aed4 ((None, [{'url': 'file:///opt/stack/data/glance/images/95aafd0b-1295-4639-b771-eb667c29aed4', 'metadata': {}}])) to volume 7137c75b-24e4-443a-86de-38add353a8b2 successfully. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 10:56:34 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Temporary image 95aafd0b-1295-4639-b771-eb667c29aed4 for user 52c3689719234b86b45bf94378c03c65 is deleted. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 10:56:34 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Marking volume 7137c75b-24e4-443a-86de-38add353a8b2 as bootable. {{(pid=86913) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 10:56:34 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Copying metadata from image 95aafd0b-1295-4639-b771-eb667c29aed4 to 7137c75b-24e4-443a-86de-38add353a8b2. {{(pid=86913) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 10:56:34 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Creating volume glance metadata for volume 7137c75b-24e4-443a-86de-38add353a8b2 backed by image 95aafd0b-1295-4639-b771-eb667c29aed4 with: {'image_id': '95aafd0b-1295-4639-b771-eb667c29aed4', 'image_name': 'tempest-scenario-img--528768695', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86913) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 10:56:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729db9fc-4e41-4fb2-a50c-e601817e8500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7137c75b-24e4-443a-86de-38add353a8b2', 'volume_size': 1, 'image_id': '95aafd0b-1295-4639-b771-eb667c29aed4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95aafd0b-1295-4639-b771-eb667c29aed4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--528768695', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '456e7ede4a5e423e801faf9e74f8d967', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95aafd0b-1295-4639-b771-eb667c29aed4', 'created_at': datetime.datetime(2026, 7, 8, 8, 56, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 56, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95aafd0b-1295-4639-b771-eb667c29aed4/file', 'properties': {}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff13f6a3-413e-4238-ae07-5f7c2e84a31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:56:34 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Volume volume-7137c75b-24e4-443a-86de-38add353a8b2 (7137c75b-24e4-443a-86de-38add353a8b2): created successfully Jul 08 10:56:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff13f6a3-413e-4238-ae07-5f7c2e84a31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:56:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Flow 'volume_create_manager' (6b8a0533-9509-4bcd-bcdb-fe84deb870d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:56:34 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9621fdb9-44e2-47af-b9a1-b32bb4ef21f3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Created volume successfully. Jul 08 10:56:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-3f8b8955-7ac3-4b12-90be-a47212639c32 req-91387e1b-4166-4cc0-8a35-72bc4a97ba87 tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:56:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-3f8b8955-7ac3-4b12-90be-a47212639c32 req-91387e1b-4166-4cc0-8a35-72bc4a97ba87 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:56:42 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c9b58c-db28-4d55-8a0f-d2a9c017e693]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:56:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-3f8b8955-7ac3-4b12-90be-a47212639c32 req-91387e1b-4166-4cc0-8a35-72bc4a97ba87 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:42 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 Jul 08 10:56:42 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:44 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-3f8b8955-7ac3-4b12-90be-a47212639c32 req-91387e1b-4166-4cc0-8a35-72bc4a97ba87 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2" returned: 0 in 1.259s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-3f8b8955-7ac3-4b12-90be-a47212639c32 req-91387e1b-4166-4cc0-8a35-72bc4a97ba87 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:44 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 Jul 08 10:56:44 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:44 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-3f8b8955-7ac3-4b12-90be-a47212639c32 req-91387e1b-4166-4cc0-8a35-72bc4a97ba87 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2" returned: 1 in 0.829s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-3f8b8955-7ac3-4b12-90be-a47212639c32 req-91387e1b-4166-4cc0-8a35-72bc4a97ba87 tempest-TestInstancesWithCinderVolumes-1104432161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:56:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-3f8b8955-7ac3-4b12-90be-a47212639c32 req-91387e1b-4166-4cc0-8a35-72bc4a97ba87 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.167s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:56:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-3f8b8955-7ac3-4b12-90be-a47212639c32 req-91387e1b-4166-4cc0-8a35-72bc4a97ba87 tempest-TestInstancesWithCinderVolumes-1104432161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-7137c75b-24e4-443a-86de-38add353a8b2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5c659ba-1ba5-472e-b3c0-66433618aa2b', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:56:45 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-3f8b8955-7ac3-4b12-90be-a47212639c32 req-91387e1b-4166-4cc0-8a35-72bc4a97ba87 tempest-TestInstancesWithCinderVolumes-1104432161 None] attachment_update completed successfully. Jul 08 10:56:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:56:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:56:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:56:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:56:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:56:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:56:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:56:53 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:56:53 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:56:54 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Jul 08 10:56:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.768s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:56:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:56:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:56:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:56:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:56:55 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=15,cinder:SELECT=23,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:56:55 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=12,cinder:UPDATE=10,cinder:INSERT=8 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Flow 'volume_create_manager' (10ba3739-b180-4a21-8099-882e9e01a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6bd268-5dc8-459c-8a65-e5a5b421e517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6bd268-5dc8-459c-8a65-e5a5b421e517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1771200569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b9802a-8c10-43a8-b788-39a79956a111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee22a1a7ba7d4fe489764eda77dee183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:57:04Z,use_quota=True,user_id='1fb8ce117693437e8f9461154fe6d9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acaf76f-f321-45a0-8d14-57dbd295be51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acaf76f-f321-45a0-8d14-57dbd295be51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f862f9-ac3b-49e2-832a-4263c08bb5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f862f9-ac3b-49e2-832a-4263c08bb5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b9802a-8c10-43a8-b788-39a79956a111', 'volume_name': 'volume-16b9802a-8c10-43a8-b788-39a79956a111', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62cdb1d-b5ac-4098-973a-26d967a87989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62cdb1d-b5ac-4098-973a-26d967a87989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a38985-e1dd-425e-95a8-764c66fcc80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:57:04 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Volume 16b9802a-8c10-43a8-b788-39a79956a111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b9802a-8c10-43a8-b788-39a79956a111', 'volume_size': 1} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1771200569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b9802a-8c10-43a8-b788-39a79956a111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee22a1a7ba7d4fe489764eda77dee183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:57:04Z,use_quota=True,user_id='1fb8ce117693437e8f9461154fe6d9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Creating volume 16b9802a-8c10-43a8-b788-39a79956a111 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:57:04 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:57:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:04 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111 1073741824 Jul 08 10:57:04 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:05 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111 1073741824" returned: 0 in 1.048s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:05 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111 Jul 08 10:57:05 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:06 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111" returned: 0 in 0.695s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:57:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:57:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a38985-e1dd-425e-95a8-764c66fcc80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b9802a-8c10-43a8-b788-39a79956a111', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:57:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94f6e2f-a6d4-4154-b2ef-a7847228ed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:57:06 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Volume volume-16b9802a-8c10-43a8-b788-39a79956a111 (16b9802a-8c10-43a8-b788-39a79956a111): created successfully Jul 08 10:57:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94f6e2f-a6d4-4154-b2ef-a7847228ed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:57:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Flow 'volume_create_manager' (10ba3739-b180-4a21-8099-882e9e01a303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:57:06 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0dfbe886-2bfc-4e4a-8552-81af51c9ca71 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Created volume successfully. Jul 08 10:57:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-cb59b48d-6454-425c-a8f6-8666f0b5f413 req-5c760307-8f38-4f0c-a156-0d95cc570062 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:57:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-cb59b48d-6454-425c-a8f6-8666f0b5f413 req-5c760307-8f38-4f0c-a156-0d95cc570062 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:57:09 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2e164c-1be6-421b-aa59-b7fdf453ba2c]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:57:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-cb59b48d-6454-425c-a8f6-8666f0b5f413 req-5c760307-8f38-4f0c-a156-0d95cc570062 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:09 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111 Jul 08 10:57:09 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:10 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-cb59b48d-6454-425c-a8f6-8666f0b5f413 req-5c760307-8f38-4f0c-a156-0d95cc570062 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111" returned: 0 in 0.779s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-cb59b48d-6454-425c-a8f6-8666f0b5f413 req-5c760307-8f38-4f0c-a156-0d95cc570062 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.796s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:57:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-cb59b48d-6454-425c-a8f6-8666f0b5f413 req-5c760307-8f38-4f0c-a156-0d95cc570062 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-16b9802a-8c10-43a8-b788-39a79956a111', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9754adc3-a00f-49e8-9883-40aa5c01c166', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:57:10 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-cb59b48d-6454-425c-a8f6-8666f0b5f413 req-5c760307-8f38-4f0c-a156-0d95cc570062 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] attachment_update completed successfully. Jul 08 10:57:16 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-be6986c3-276a-40a4-8fbb-aa3f273526cb req-1633cdd9-6127-4b7b-9759-b161c920d88d tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Terminate volume connection completed successfully. Jul 08 10:57:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-be6986c3-276a-40a4-8fbb-aa3f273526cb req-1633cdd9-6127-4b7b-9759-b161c920d88d tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Deleting attachment 9754adc3-a00f-49e8-9883-40aa5c01c166. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:57:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Acquiring lock "cinder-16b9802a-8c10-43a8-b788-39a79956a111-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:57:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "cinder-16b9802a-8c10-43a8-b788-39a79956a111-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:57:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Acquiring lock "cinder-quobyte-16b9802a-8c10-43a8-b788-39a79956a111" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:57:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "cinder-quobyte-16b9802a-8c10-43a8-b788-39a79956a111" acquired by "delete_volume" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:57:18 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b2380a-3a78-4c2a-86c0-cf41f360419d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:57:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:18 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111 Jul 08 10:57:18 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:19 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111" returned: 0 in 0.754s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:19 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111 Jul 08 10:57:19 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:20 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-16b9802a-8c10-43a8-b788-39a79956a111" returned: 0 in 0.652s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "cinder-quobyte-16b9802a-8c10-43a8-b788-39a79956a111" released by "delete_volume" :: held 1.444s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Created reservations ['cff91391-7bbd-4a0e-9488-fb8fe2351e40', '272f897a-1a14-46bf-bf69-9d7122bd4317', 'e76c0c4f-f401-4687-911f-44c3ed15766f', 'c66acbe3-eea0-40e1-99cb-5176568cbebe'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:20 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:57:20 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:20 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.669s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:57:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Deleted volume successfully. Jul 08 10:57:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2c57ebea-a3f6-4de1-897f-379bbb6fb6e0 tempest-TestServerVolumeAttachScenarioOldVersion-909066608 None] Lock "cinder-16b9802a-8c10-43a8-b788-39a79956a111-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:57:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-b6300890-ac1d-43ac-b9d6-97ec76c8ce13 req-a4084a57-5ead-4b90-9997-dc91c66d5ae0 tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:57:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-b6300890-ac1d-43ac-b9d6-97ec76c8ce13 req-a4084a57-5ead-4b90-9997-dc91c66d5ae0 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:57:22 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[11089516-f311-4b92-a894-d2d805df8638]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:57:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-b6300890-ac1d-43ac-b9d6-97ec76c8ce13 req-a4084a57-5ead-4b90-9997-dc91c66d5ae0 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:22 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca Jul 08 10:57:22 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:23 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-b6300890-ac1d-43ac-b9d6-97ec76c8ce13 req-a4084a57-5ead-4b90-9997-dc91c66d5ae0 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca" returned: 0 in 0.963s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-b6300890-ac1d-43ac-b9d6-97ec76c8ce13 req-a4084a57-5ead-4b90-9997-dc91c66d5ae0 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:57:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-b6300890-ac1d-43ac-b9d6-97ec76c8ce13 req-a4084a57-5ead-4b90-9997-dc91c66d5ae0 tempest-TestInstancesWithCinderVolumes-1104432161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-091958c6-795f-4bb4-90f9-3a8e551c78ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5adcbe98-942f-44a1-9faf-72ca95336b11', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:57:23 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-b6300890-ac1d-43ac-b9d6-97ec76c8ce13 req-a4084a57-5ead-4b90-9997-dc91c66d5ae0 tempest-TestInstancesWithCinderVolumes-1104432161 None] attachment_update completed successfully. Jul 08 10:57:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-be05bdcb-4ffd-49c1-a457-564c85acbf4d req-6548b1e9-f86b-4c38-86b4-8d6fc8ba3a6d tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:57:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-be05bdcb-4ffd-49c1-a457-564c85acbf4d req-6548b1e9-f86b-4c38-86b4-8d6fc8ba3a6d tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:57:31 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6634ca8-b60a-4207-aae5-19b8b80c775f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:57:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-be05bdcb-4ffd-49c1-a457-564c85acbf4d req-6548b1e9-f86b-4c38-86b4-8d6fc8ba3a6d tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:31 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138 Jul 08 10:57:31 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:31 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-be05bdcb-4ffd-49c1-a457-564c85acbf4d req-6548b1e9-f86b-4c38-86b4-8d6fc8ba3a6d tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138" returned: 0 in 0.798s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-be05bdcb-4ffd-49c1-a457-564c85acbf4d req-6548b1e9-f86b-4c38-86b4-8d6fc8ba3a6d tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.816s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:57:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-be05bdcb-4ffd-49c1-a457-564c85acbf4d req-6548b1e9-f86b-4c38-86b4-8d6fc8ba3a6d tempest-TestInstancesWithCinderVolumes-1104432161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-80c318fa-3e08-407f-a689-7798be7e7138', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e147721b-ae22-41df-9c66-32ebe89a75b0', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:57:31 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-be05bdcb-4ffd-49c1-a457-564c85acbf4d req-6548b1e9-f86b-4c38-86b4-8d6fc8ba3a6d tempest-TestInstancesWithCinderVolumes-1104432161 None] attachment_update completed successfully. Jul 08 10:57:41 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-e8a86d66-4303-4400-a26a-09757b97ebb9 req-dd968879-5346-47c7-8771-fc455824d9b9 tempest-TestInstancesWithCinderVolumes-1104432161 None] Terminate volume connection completed successfully. Jul 08 10:57:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-e8a86d66-4303-4400-a26a-09757b97ebb9 req-dd968879-5346-47c7-8771-fc455824d9b9 tempest-TestInstancesWithCinderVolumes-1104432161 None] Deleting attachment 5adcbe98-942f-44a1-9faf-72ca95336b11. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:57:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "cinder-091958c6-795f-4bb4-90f9-3a8e551c78ca-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:57:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-091958c6-795f-4bb4-90f9-3a8e551c78ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:57:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "cinder-quobyte-091958c6-795f-4bb4-90f9-3a8e551c78ca" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:57:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-quobyte-091958c6-795f-4bb4-90f9-3a8e551c78ca" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:57:43 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4724991f-4f94-4d53-a448-7891d00b3dca]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:57:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:43 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca Jul 08 10:57:43 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:44 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca" returned: 0 in 1.246s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:44 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca Jul 08 10:57:44 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:45 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-091958c6-795f-4bb4-90f9-3a8e551c78ca" returned: 0 in 0.889s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-quobyte-091958c6-795f-4bb4-90f9-3a8e551c78ca" released by "delete_volume" :: held 2.184s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:57:45 devstack cinder-volume[86913]: WARNING cinder.quota [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-965744904-366545658 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-965744904-366545658, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:57:45 devstack cinder-volume[86913]: WARNING cinder.quota [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-965744904-366545658 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-965744904-366545658, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:57:45 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Created reservations ['e0b16950-e8c1-4754-b64d-8a8060424f06', '074a0010-aed0-4f24-bd16-2abe453341b4', '8f5d93c9-7726-439a-8d20-87777847d43c', 'bf214ecf-c329-40fe-a427-2af811e533fc'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:57:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:57:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:57:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:57:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:57:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:57:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:45 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:57:45 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:46 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.737s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:46 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:57:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Deleted volume successfully. Jul 08 10:57:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d4c71abb-7bfd-4b99-951b-4838cdb1915d tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-091958c6-795f-4bb4-90f9-3a8e551c78ca-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:57:48 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-f518474e-5ae0-49fa-a2f2-e1195a3f6a92 req-bb4c7a2b-e204-4f2d-9dae-42abe26f97bb tempest-TestInstancesWithCinderVolumes-1104432161 None] Terminate volume connection completed successfully. Jul 08 10:57:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-f518474e-5ae0-49fa-a2f2-e1195a3f6a92 req-bb4c7a2b-e204-4f2d-9dae-42abe26f97bb tempest-TestInstancesWithCinderVolumes-1104432161 None] Deleting attachment e147721b-ae22-41df-9c66-32ebe89a75b0. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:57:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "cinder-80c318fa-3e08-407f-a689-7798be7e7138-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:57:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-80c318fa-3e08-407f-a689-7798be7e7138-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:57:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "cinder-quobyte-80c318fa-3e08-407f-a689-7798be7e7138" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:57:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-quobyte-80c318fa-3e08-407f-a689-7798be7e7138" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:57:50 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7f247c-4a73-4f07-93df-b45747869843]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:57:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:50 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138 Jul 08 10:57:50 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:51 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138" returned: 0 in 0.927s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:51 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138 Jul 08 10:57:51 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:52 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-80c318fa-3e08-407f-a689-7798be7e7138" returned: 0 in 0.874s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-quobyte-80c318fa-3e08-407f-a689-7798be7e7138" released by "delete_volume" :: held 1.860s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:57:52 devstack cinder-volume[86913]: WARNING cinder.quota [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1089699855-1989210899 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1089699855-1989210899, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:57:52 devstack cinder-volume[86913]: WARNING cinder.quota [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1089699855-1989210899 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1089699855-1989210899, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:57:52 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Created reservations ['508f7680-a338-4408-b09a-7885d3624217', 'd35aec0a-01c9-4777-8f93-5f5242820a5e', '4e357462-da8b-4cba-804c-46f673f24d0b', '9d54aada-b7df-4e9e-96c9-b959a7e1ce1c'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:57:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:57:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:57:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:57:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:57:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:57:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:52 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:57:52 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:53 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.805s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:53 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:57:53 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Deleted volume successfully. Jul 08 10:57:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae03f8ba-f5f0-496b-a3a5-1e501223f2ce tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-80c318fa-3e08-407f-a689-7798be7e7138-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:57:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:57:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:57:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:57:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:57:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:57:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:57:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:57:53 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:57:53 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:57:54 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jul 08 10:57:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.693s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:57:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:57:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:57:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:57:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:57:57 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=38,cinder:UPDATE=28,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:57:57 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=37,cinder:UPDATE=35,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:57:57 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-2de5608a-9ac3-4ff3-97dd-dbb54eed7f13 req-62eefa4e-cd19-4acb-be53-48e5630f5b3f tempest-TestInstancesWithCinderVolumes-1104432161 None] Terminate volume connection completed successfully. Jul 08 10:57:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-2de5608a-9ac3-4ff3-97dd-dbb54eed7f13 req-62eefa4e-cd19-4acb-be53-48e5630f5b3f tempest-TestInstancesWithCinderVolumes-1104432161 None] Deleting attachment c5c659ba-1ba5-472e-b3c0-66433618aa2b. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:58:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "cinder-7137c75b-24e4-443a-86de-38add353a8b2-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:58:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-7137c75b-24e4-443a-86de-38add353a8b2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:58:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "cinder-quobyte-7137c75b-24e4-443a-86de-38add353a8b2" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:58:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-quobyte-7137c75b-24e4-443a-86de-38add353a8b2" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:58:01 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bef504-eb3f-4a42-819d-5615df76f865]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:58:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:01 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 Jul 08 10:58:01 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:02 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2" returned: 0 in 0.791s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:02 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 Jul 08 10:58:02 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:03 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2" returned: 1 in 0.812s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:58:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:03 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2 Jul 08 10:58:03 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:03 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7137c75b-24e4-443a-86de-38add353a8b2" returned: 0 in 0.689s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:03 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-quobyte-7137c75b-24e4-443a-86de-38add353a8b2" released by "delete_volume" :: held 2.355s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:58:03 devstack cinder-volume[86913]: WARNING cinder.quota [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-700948193-1821840391 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-700948193-1821840391, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:58:03 devstack cinder-volume[86913]: WARNING cinder.quota [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-700948193-1821840391 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-700948193-1821840391, it is now deprecated. Please use the default quota class for default quota. Jul 08 10:58:03 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Created reservations ['98df451b-bd67-4d24-bd17-c580d4cb15db', '3fd00283-9606-4ff6-8278-d1ddfb615af3', '932f5947-fa9e-4589-854e-6f23111fa741', '226a5985-0378-4e98-bff6-b357ea7fe3e5'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:58:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:58:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:58:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:58:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:58:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:58:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:04 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:58:04 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:04 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.679s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:04 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:58:04 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Deleted volume successfully. Jul 08 10:58:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52ab9bac-a723-44d2-9e45-c61f713361e3 tempest-TestInstancesWithCinderVolumes-1104432161 None] Lock "cinder-7137c75b-24e4-443a-86de-38add353a8b2-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Flow 'volume_create_manager' (6db62dd1-f8fc-4bbf-8948-1250bebfe30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744a1bbc-d957-453c-855c-cbe2f5ec7436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744a1bbc-d957-453c-855c-cbe2f5ec7436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2045325269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc4b0f3-0d6d-498d-92c3-311a0408d6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18fda6874f7340e7b242fe52e755e6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:58:05Z,use_quota=True,user_id='8c21404a1221472393c7ec5907649988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333bd236-51a1-4761-a808-968dec8022a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333bd236-51a1-4761-a808-968dec8022a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffd490e-b06c-4c98-9cd3-aff17dff6be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.image.glance [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Creating Keystone auth plugin from conf {{(pid=86913) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffd490e-b06c-4c98-9cd3-aff17dff6be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fc4b0f3-0d6d-498d-92c3-311a0408d6de', 'volume_name': 'volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b93b72b-7482-4c8a-b5c3-c2841f9d8003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b93b72b-7482-4c8a-b5c3-c2841f9d8003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16bea4ba-301a-49f6-b142-e49c0947b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:05 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Volume 3fc4b0f3-0d6d-498d-92c3-311a0408d6de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Trying to clone 3fc4b0f3-0d6d-498d-92c3-311a0408d6de from image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]). {{(pid=86913) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 10:58:05 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Image download 20.69 MB at 20.69 MB/s Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[be048fc0-c5a2-4164-9a21-f4ff168e55f9]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:58:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:06 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD Jul 08 10:58:06 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:06 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:06 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Temporary image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c is fetched for user 8c21404a1221472393c7ec5907649988. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 10:58:06 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb569ee-4b75-421d-b13a-c30e2e880c6a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:58:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:06 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD Jul 08 10:58:06 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:07 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2045325269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc4b0f3-0d6d-498d-92c3-311a0408d6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18fda6874f7340e7b242fe52e755e6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:58:05Z,use_quota=True,user_id='8c21404a1221472393c7ec5907649988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Creating volume 3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:58:07 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:58:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:07 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de 1073741824 Jul 08 10:58:07 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:08 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de 1073741824" returned: 0 in 0.883s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:08 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de Jul 08 10:58:08 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:09 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" returned: 0 in 0.727s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:58:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:58:09 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Attempting download of 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c ((None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}])) to volume 3fc4b0f3-0d6d-498d-92c3-311a0408d6de. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 10:58:09 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b204da1a-b4c5-4120-ac78-c5dc99584372]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:58:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_416x7vg1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:09 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_416x7vg1 Jul 08 10:58:09 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:10 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_416x7vg1" returned: 0 in 0.805s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_416x7vg1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:10 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_416x7vg1 Jul 08 10:58:10 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:11 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_416x7vg1" returned: 1 in 0.837s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_416x7vg1' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:58:11 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[22924ef7-13c1-4496-a5aa-6892e7ff08de]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:58:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:11 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD Jul 08 10:58:11 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:11 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:11 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c was qcow2, converting to raw {{(pid=86913) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 10:58:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:11 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de Jul 08 10:58:11 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:14 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" returned: 0 in 2.253s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:14 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a2f6904-d05f-4b2a-8dd9-c0f90985a43c_ta7c8d6udevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 10:58:14 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Converted 112.00 MB image at 49.68 MB/s Jul 08 10:58:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:14 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de 1G Jul 08 10:58:14 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:14 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de 1G" returned: 0 in 0.783s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:14 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de2da67-f241-4167-b050-e21984fd3759]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:58:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:15 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de Jul 08 10:58:15 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:15 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" returned: 0 in 0.819s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:15 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de Jul 08 10:58:15 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:16 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" returned: 1 in 0.846s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:58:16 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Downloaded image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c ((None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}])) to volume 3fc4b0f3-0d6d-498d-92c3-311a0408d6de successfully. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 10:58:16 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Temporary image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c for user 8c21404a1221472393c7ec5907649988 is deleted. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 10:58:16 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Marking volume 3fc4b0f3-0d6d-498d-92c3-311a0408d6de as bootable. {{(pid=86913) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 10:58:16 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Copying metadata from image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c to 3fc4b0f3-0d6d-498d-92c3-311a0408d6de. {{(pid=86913) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 10:58:16 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Creating volume glance metadata for volume 3fc4b0f3-0d6d-498d-92c3-311a0408d6de backed by image 5a2f6904-d05f-4b2a-8dd9-c0f90985a43c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86913) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 10:58:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16bea4ba-301a-49f6-b142-e49c0947b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de', 'volume_size': 1, 'image_id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '267569b6929748299c5505a36d3359c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a2f6904-d05f-4b2a-8dd9-c0f90985a43c', 'created_at': datetime.datetime(2026, 7, 8, 8, 33, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 8, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a2f6904-d05f-4b2a-8dd9-c0f90985a43c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136f0a72-67ab-4145-9067-d3f67d496fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:16 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Volume volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de (3fc4b0f3-0d6d-498d-92c3-311a0408d6de): created successfully Jul 08 10:58:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136f0a72-67ab-4145-9067-d3f67d496fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Flow 'volume_create_manager' (6db62dd1-f8fc-4bbf-8948-1250bebfe30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:58:16 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1e48b66d-1161-4709-a63b-7e990a641b06 tempest-TestShelveInstance-298118755 None] Created volume successfully. Jul 08 10:58:26 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=18,cinder:INSERT=9,cinder:UPDATE=16 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:58:26 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=10,cinder:SELECT=12,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:58:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-a1544049-1c2c-41db-9f46-dbc0bce420de req-03a1a1c5-3637-4c57-b846-87ecddf0d844 tempest-TestShelveInstance-298118755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:58:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-a1544049-1c2c-41db-9f46-dbc0bce420de req-03a1a1c5-3637-4c57-b846-87ecddf0d844 tempest-TestShelveInstance-298118755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:58:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e36ce-0d97-4ae3-88da-d9d5ae8c6684]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:58:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-a1544049-1c2c-41db-9f46-dbc0bce420de req-03a1a1c5-3637-4c57-b846-87ecddf0d844 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:27 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de Jul 08 10:58:27 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:28 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-a1544049-1c2c-41db-9f46-dbc0bce420de req-03a1a1c5-3637-4c57-b846-87ecddf0d844 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" returned: 0 in 0.845s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-a1544049-1c2c-41db-9f46-dbc0bce420de req-03a1a1c5-3637-4c57-b846-87ecddf0d844 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:28 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de Jul 08 10:58:28 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:29 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-a1544049-1c2c-41db-9f46-dbc0bce420de req-03a1a1c5-3637-4c57-b846-87ecddf0d844 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" returned: 1 in 0.786s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-a1544049-1c2c-41db-9f46-dbc0bce420de req-03a1a1c5-3637-4c57-b846-87ecddf0d844 tempest-TestShelveInstance-298118755 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:58:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-a1544049-1c2c-41db-9f46-dbc0bce420de req-03a1a1c5-3637-4c57-b846-87ecddf0d844 tempest-TestShelveInstance-298118755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.681s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:58:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-a1544049-1c2c-41db-9f46-dbc0bce420de req-03a1a1c5-3637-4c57-b846-87ecddf0d844 tempest-TestShelveInstance-298118755 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6769beb4-f3e8-444a-9ea6-a4eb34df2711', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:58:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-a1544049-1c2c-41db-9f46-dbc0bce420de req-03a1a1c5-3637-4c57-b846-87ecddf0d844 tempest-TestShelveInstance-298118755 None] attachment_update completed successfully. Jul 08 10:58:39 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:58:39 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:58:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:58:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:58:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:58:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:58:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:58:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:58:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:53 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:58:53 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:54 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.696s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:58:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:58:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:58:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Flow 'volume_create_manager' (57ecd8a0-fded-4b87-a53c-04d58647c88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee15458-913a-4ea2-a640-ed2e93f301c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee15458-913a-4ea2-a640-ed2e93f301c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1882114717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9047011d-54e2-4b56-a2cb-3c3f031bc580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='289774afb2184b8b83550d9226338c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:58:56Z,use_quota=True,user_id='362e5ea817f140bfbf29e5bc71da4828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad0865d-7d06-458c-93a0-0819d8223d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad0865d-7d06-458c-93a0-0819d8223d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76065969-9d0d-45aa-b614-4d1f102615e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76065969-9d0d-45aa-b614-4d1f102615e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9047011d-54e2-4b56-a2cb-3c3f031bc580', 'volume_name': 'volume-9047011d-54e2-4b56-a2cb-3c3f031bc580', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a5a605-88a7-47a1-9114-298bfa920868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a5a605-88a7-47a1-9114-298bfa920868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01ecff5-e8ba-4ae3-b39e-8fce13715ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:56 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Volume 9047011d-54e2-4b56-a2cb-3c3f031bc580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9047011d-54e2-4b56-a2cb-3c3f031bc580', 'volume_size': 1} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T08:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1882114717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9047011d-54e2-4b56-a2cb-3c3f031bc580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='289774afb2184b8b83550d9226338c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T08:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T08:58:56Z,use_quota=True,user_id='362e5ea817f140bfbf29e5bc71da4828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Creating volume 9047011d-54e2-4b56-a2cb-3c3f031bc580 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 10:58:56 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 10:58:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:56 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 1073741824 Jul 08 10:58:56 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:57 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 1073741824" returned: 0 in 0.830s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:58:57 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 Jul 08 10:58:57 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:58:57 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Jul 08 10:58:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580" returned: 0 in 0.687s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:58:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 10:58:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:58:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01ecff5-e8ba-4ae3-b39e-8fce13715ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9047011d-54e2-4b56-a2cb-3c3f031bc580', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0a4284-0f3f-4665-b747-61ce65070409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 10:58:58 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Volume volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 (9047011d-54e2-4b56-a2cb-3c3f031bc580): created successfully Jul 08 10:58:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0a4284-0f3f-4665-b747-61ce65070409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 10:58:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Flow 'volume_create_manager' (57ecd8a0-fded-4b87-a53c-04d58647c88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 10:58:58 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3bf75ce5-97e1-4887-9f39-f706b6efc351 tempest-TestMinimumBasicScenario-345664754 None] Created volume successfully. Jul 08 10:59:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-e7cb3d08-4b24-4a81-bd9b-4a0a52d6bbe9 req-a6ab66f3-676e-4b86-b7e2-281c1946aa5a tempest-TestMinimumBasicScenario-345664754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:59:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-e7cb3d08-4b24-4a81-bd9b-4a0a52d6bbe9 req-a6ab66f3-676e-4b86-b7e2-281c1946aa5a tempest-TestMinimumBasicScenario-345664754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:59:01 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c476bfbd-6a57-4247-9f43-8ad460e75216]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:59:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-e7cb3d08-4b24-4a81-bd9b-4a0a52d6bbe9 req-a6ab66f3-676e-4b86-b7e2-281c1946aa5a tempest-TestMinimumBasicScenario-345664754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:59:01 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 Jul 08 10:59:01 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:59:02 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Jul 08 10:59:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-e7cb3d08-4b24-4a81-bd9b-4a0a52d6bbe9 req-a6ab66f3-676e-4b86-b7e2-281c1946aa5a tempest-TestMinimumBasicScenario-345664754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580" returned: 0 in 0.848s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:59:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-e7cb3d08-4b24-4a81-bd9b-4a0a52d6bbe9 req-a6ab66f3-676e-4b86-b7e2-281c1946aa5a tempest-TestMinimumBasicScenario-345664754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.867s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:59:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-e7cb3d08-4b24-4a81-bd9b-4a0a52d6bbe9 req-a6ab66f3-676e-4b86-b7e2-281c1946aa5a tempest-TestMinimumBasicScenario-345664754 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-9047011d-54e2-4b56-a2cb-3c3f031bc580', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f17f085-f111-44c6-bb02-0977eeda42c5', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:59:02 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-e7cb3d08-4b24-4a81-bd9b-4a0a52d6bbe9 req-a6ab66f3-676e-4b86-b7e2-281c1946aa5a tempest-TestMinimumBasicScenario-345664754 None] attachment_update completed successfully. Jul 08 10:59:10 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-55a179a2-ea3c-4d6c-9c6d-fc98034f7bb9 req-5228bedf-4778-4090-b00b-f72d60e3a22c tempest-TestShelveInstance-298118755 None] Terminate volume connection completed successfully. Jul 08 10:59:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-55a179a2-ea3c-4d6c-9c6d-fc98034f7bb9 req-5228bedf-4778-4090-b00b-f72d60e3a22c tempest-TestShelveInstance-298118755 None] Deleting attachment 6769beb4-f3e8-444a-9ea6-a4eb34df2711. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:59:12 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=6,cinder:INSERT=1,cinder:SELECT=5 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:59:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-c6151cae-2a73-4d66-8b38-9b7632c265f4 req-d3d7a361-b75b-44ce-9e40-b35dd2dc7721 tempest-TestShelveInstance-298118755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:59:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-c6151cae-2a73-4d66-8b38-9b7632c265f4 req-d3d7a361-b75b-44ce-9e40-b35dd2dc7721 tempest-TestShelveInstance-298118755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:59:15 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b50fb9-228e-4ca4-8851-00e981f91ce0]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:59:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-c6151cae-2a73-4d66-8b38-9b7632c265f4 req-d3d7a361-b75b-44ce-9e40-b35dd2dc7721 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:59:15 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de Jul 08 10:59:15 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:59:16 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Jul 08 10:59:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-c6151cae-2a73-4d66-8b38-9b7632c265f4 req-d3d7a361-b75b-44ce-9e40-b35dd2dc7721 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" returned: 0 in 0.804s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:59:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-c6151cae-2a73-4d66-8b38-9b7632c265f4 req-d3d7a361-b75b-44ce-9e40-b35dd2dc7721 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:59:16 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de Jul 08 10:59:16 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:59:17 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Jul 08 10:59:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-c6151cae-2a73-4d66-8b38-9b7632c265f4 req-d3d7a361-b75b-44ce-9e40-b35dd2dc7721 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" returned: 1 in 0.780s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:59:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-c6151cae-2a73-4d66-8b38-9b7632c265f4 req-d3d7a361-b75b-44ce-9e40-b35dd2dc7721 tempest-TestShelveInstance-298118755 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:59:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-c6151cae-2a73-4d66-8b38-9b7632c265f4 req-d3d7a361-b75b-44ce-9e40-b35dd2dc7721 tempest-TestShelveInstance-298118755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.622s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:59:17 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-c6151cae-2a73-4d66-8b38-9b7632c265f4 req-d3d7a361-b75b-44ce-9e40-b35dd2dc7721 tempest-TestShelveInstance-298118755 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98', 'name': 'volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9edfcf7f-95b6-46fb-880a-aaa3314501c1', 'enforce_multipath': True} {{(pid=86913) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 10:59:17 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-c6151cae-2a73-4d66-8b38-9b7632c265f4 req-d3d7a361-b75b-44ce-9e40-b35dd2dc7721 tempest-TestShelveInstance-298118755 None] attachment_update completed successfully. Jul 08 10:59:27 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:59:27 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 10:59:48 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-491b0be1-a8de-4bf7-bf9d-f76ade9d022f req-91988a75-7857-4e32-af6a-94e71304b645 tempest-TestMinimumBasicScenario-345664754 None] Terminate volume connection completed successfully. Jul 08 10:59:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-491b0be1-a8de-4bf7-bf9d-f76ade9d022f req-91988a75-7857-4e32-af6a-94e71304b645 tempest-TestMinimumBasicScenario-345664754 None] Deleting attachment 1f17f085-f111-44c6-bb02-0977eeda42c5. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:59:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Acquiring lock "cinder-9047011d-54e2-4b56-a2cb-3c3f031bc580-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:59:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Lock "cinder-9047011d-54e2-4b56-a2cb-3c3f031bc580-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:59:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Acquiring lock "cinder-quobyte-9047011d-54e2-4b56-a2cb-3c3f031bc580" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:59:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Lock "cinder-quobyte-9047011d-54e2-4b56-a2cb-3c3f031bc580" acquired by "delete_volume" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:59:50 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[10812f26-261c-4ac4-b098-ae47fff9f451]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:59:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:59:50 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 Jul 08 10:59:50 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:59:51 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Jul 08 10:59:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580" returned: 0 in 0.768s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:59:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:59:51 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580 Jul 08 10:59:51 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:59:52 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Jul 08 10:59:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9047011d-54e2-4b56-a2cb-3c3f031bc580" returned: 0 in 0.703s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:59:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Lock "cinder-quobyte-9047011d-54e2-4b56-a2cb-3c3f031bc580" released by "delete_volume" :: held 1.516s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:59:52 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Created reservations ['4d58406e-8ed0-4eb7-ac2c-fda4b8e6526d', '5c7faa10-3907-46c3-bd9f-a5715c9a3e4c', '28d1b456-fe21-432c-a772-7e6d85ae9fee', '63a5e044-75c1-4546-811a-fb081e0edc10'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:59:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:59:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:59:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:59:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:59:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:59:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:59:52 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:59:52 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:59:53 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Jul 08 10:59:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.682s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:59:53 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:59:53 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Deleted volume successfully. Jul 08 10:59:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4f898607-d146-4a0b-98aa-55b9c3d91816 tempest-TestMinimumBasicScenario-345664754 None] Lock "cinder-9047011d-54e2-4b56-a2cb-3c3f031bc580-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:59:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:59:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:59:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:59:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:59:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:59:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:59:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:59:53 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:59:53 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:59:54 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Jul 08 10:59:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.838s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:59:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 10:59:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 10:59:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 10:59:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 10:59:56 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-e7d2a81b-f471-4d17-931d-c41e456f0587 tempest-TestShelveInstance-298118755 None] Terminate volume connection completed successfully. Jul 08 10:59:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-e7d2a81b-f471-4d17-931d-c41e456f0587 tempest-TestShelveInstance-298118755 None] Deleting attachment 9edfcf7f-95b6-46fb-880a-aaa3314501c1. {{(pid=86913) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 10:59:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Acquiring lock "cinder-3fc4b0f3-0d6d-498d-92c3-311a0408d6de-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:59:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Lock "cinder-3fc4b0f3-0d6d-498d-92c3-311a0408d6de-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:59:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Acquiring lock "cinder-quobyte-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 10:59:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Lock "cinder-quobyte-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 10:59:57 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[464cce34-f74b-425b-8252-598bf6891044]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 10:59:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:59:57 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de Jul 08 10:59:57 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:59:57 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 08 10:59:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" returned: 0 in 0.751s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:59:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:59:58 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de Jul 08 10:59:58 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:59:58 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Jul 08 10:59:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" returned: 1 in 0.741s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:59:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 10:59:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:59:58 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de Jul 08 10:59:58 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 10:59:59 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Jul 08 10:59:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" returned: 0 in 0.643s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 10:59:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Lock "cinder-quobyte-3fc4b0f3-0d6d-498d-92c3-311a0408d6de" released by "delete_volume" :: held 2.200s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 10:59:59 devstack cinder-volume[86913]: DEBUG cinder.quota [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Created reservations ['0d2c6457-eaac-4701-8ab3-d0ed43889b60', 'e4296d3c-fb87-42c6-8392-1e3b4221abdf', 'd796a6df-c381-4617-834d-b23268daebad', '46941e09-506b-47bf-a6d9-cf32c20df160'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 10:59:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 10:59:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 10:59:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 10:59:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 10:59:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 10:59:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 10:59:59 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 10:59:59 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:00 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.651s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:00 devstack cinder-volume[86913]: DEBUG cinder.manager [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:00:00 devstack cinder-volume[86913]: INFO cinder.volume.manager [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Deleted volume successfully. Jul 08 11:00:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [req-74af719f-639a-4887-bef7-0c7f43b75d63 req-b2ec7f67-cf74-4754-b01f-23525935e8f5 tempest-TestShelveInstance-298118755 None] Lock "cinder-3fc4b0f3-0d6d-498d-92c3-311a0408d6de-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:09 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=12,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Flow 'volume_create_manager' (fe4a590e-9ef1-4226-aeff-240c0ca004b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c389bfd7-b4c2-49ec-bd83-259cb7c4c932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c389bfd7-b4c2-49ec-bd83-259cb7c4c932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-33288656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf194f0e-7a45-4274-8f11-227b59177c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27053feb6e64415b39929637c8f6d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:12Z,use_quota=True,user_id='c23c2f11715f4b3a88f13c4c5891dcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c981d04-e9f8-452b-b649-081072a8c4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c981d04-e9f8-452b-b649-081072a8c4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce048e4f-2948-4ca6-bffd-6ee284f42fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce048e4f-2948-4ca6-bffd-6ee284f42fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf194f0e-7a45-4274-8f11-227b59177c8d', 'volume_name': 'volume-cf194f0e-7a45-4274-8f11-227b59177c8d', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960844ab-cbde-4e0c-bd0f-d283ef213423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960844ab-cbde-4e0c-bd0f-d283ef213423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8060f7d9-6763-45c2-a570-0db8f79b43b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:11 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Volume cf194f0e-7a45-4274-8f11-227b59177c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf194f0e-7a45-4274-8f11-227b59177c8d', 'volume_size': 1} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-33288656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf194f0e-7a45-4274-8f11-227b59177c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27053feb6e64415b39929637c8f6d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:12Z,use_quota=True,user_id='c23c2f11715f4b3a88f13c4c5891dcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Creating volume cf194f0e-7a45-4274-8f11-227b59177c8d {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:00:11 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:00:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:11 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d 1073741824 Jul 08 11:00:12 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:12 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d 1073741824" returned: 0 in 0.882s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:12 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d Jul 08 11:00:12 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:13 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d" returned: 0 in 0.664s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:00:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8060f7d9-6763-45c2-a570-0db8f79b43b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf194f0e-7a45-4274-8f11-227b59177c8d', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031433f9-67b0-4719-a661-eff84743893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:13 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Volume volume-cf194f0e-7a45-4274-8f11-227b59177c8d (cf194f0e-7a45-4274-8f11-227b59177c8d): created successfully Jul 08 11:00:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031433f9-67b0-4719-a661-eff84743893e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Flow 'volume_create_manager' (fe4a590e-9ef1-4226-aeff-240c0ca004b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:13 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1c847c76-a5d1-4746-a3a1-e7d2b9752e7e tempest-VolumeDependencyTests-51471643 None] Created volume successfully. Jul 08 11:00:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] Creating offline snapshot 037a0011-9dfd-4a6d-bef9-2a0742c64592 of volume cf194f0e-7a45-4274-8f11-227b59177c8d {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:00:14 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf8ffb1-2825-484a-b406-1eca439c566f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:14 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d Jul 08 11:00:14 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:14 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d" returned: 0 in 0.774s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:14 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 1G Jul 08 11:00:14 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:15 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 1G" returned: 0 in 0.885s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf194f0e-7a45-4274-8f11-227b59177c8d -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:15 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf194f0e-7a45-4274-8f11-227b59177c8d -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 Jul 08 11:00:15 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Flow 'volume_create_manager' (7d1822b5-c0df-4dac-8652-1cb3797cdd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df092949-943c-47ad-bbe2-605a00673108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df092949-943c-47ad-bbe2-605a00673108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1edad66e-b5a1-4c01-af9f-9a4917becb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c273ae4460444128957201207258a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:16Z,use_quota=True,user_id='e21b563bcbe04b07b281e7bd6385bab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1398d3e2-6ca2-4171-a897-a23dbe50f33f),volume_type_id=1398d3e2-6ca2-4171-a897-a23dbe50f33f)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64542ad-3688-4fbc-b7de-2869b7fb198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64542ad-3688-4fbc-b7de-2869b7fb198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70eda20-c1fe-47da-9361-e66c95c4535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.image.glance [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Creating Keystone auth plugin from conf {{(pid=86913) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:00:16 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70eda20-c1fe-47da-9361-e66c95c4535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1edad66e-b5a1-4c01-af9f-9a4917becb1e', 'volume_name': 'volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e', 'volume_size': 1, 'image_id': 'ff137e27-fbbd-4b53-9f12-78296ea52487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff137e27-fbbd-4b53-9f12-78296ea52487', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6593ba5cd9da3fcadaf77df628cdd4bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c273ae4460444128957201207258a9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b159b02e410484aaf677df480988541271629738b1afd3b0813776c4e134e47d5dc6411dc28335fa1515219deecc00451a978a06e6b844d6101f82b6433ed5d9', 'id': 'ff137e27-fbbd-4b53-9f12-78296ea52487', 'created_at': datetime.datetime(2026, 7, 8, 9, 0, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 0, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff137e27-fbbd-4b53-9f12-78296ea52487/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71b259a-bbae-4c22-9ed2-e4456f651241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71b259a-bbae-4c22-9ed2-e4456f651241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbd4eae-fa24-4d27-98c1-32033e8d4734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:16 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Volume 1edad66e-b5a1-4c01-af9f-9a4917becb1e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e', 'volume_size': 1, 'image_id': 'ff137e27-fbbd-4b53-9f12-78296ea52487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff137e27-fbbd-4b53-9f12-78296ea52487', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6593ba5cd9da3fcadaf77df628cdd4bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c273ae4460444128957201207258a9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b159b02e410484aaf677df480988541271629738b1afd3b0813776c4e134e47d5dc6411dc28335fa1515219deecc00451a978a06e6b844d6101f82b6433ed5d9', 'id': 'ff137e27-fbbd-4b53-9f12-78296ea52487', 'created_at': datetime.datetime(2026, 7, 8, 9, 0, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 0, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff137e27-fbbd-4b53-9f12-78296ea52487/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Trying to clone 1edad66e-b5a1-4c01-af9f-9a4917becb1e from image ff137e27-fbbd-4b53-9f12-78296ea52487 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ff137e27-fbbd-4b53-9f12-78296ea52487', 'metadata': {}}]). {{(pid=86913) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf194f0e-7a45-4274-8f11-227b59177c8d -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592" returned: 0 in 0.775s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:16 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 is being set with open permissions: ugo+rw Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:16 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 Jul 08 11:00:16 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:00:16 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Image download 0.00 MB at 0.00 MB/s Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[41230297-d175-4863-a664-36db9c09632d]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:16 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD Jul 08 11:00:16 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:17 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592" returned: 0 in 0.658s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:17 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.info Jul 08 11:00:17 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:17 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:17 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD Jul 08 11:00:17 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:17 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.info" returned: 0 in 0.651s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:17 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.info is being set with open permissions: ugo+rw Jul 08 11:00:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:18 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.info Jul 08 11:00:18 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:18 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD" returned: 1 in 0.711s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:00:18 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Temporary image ff137e27-fbbd-4b53-9f12-78296ea52487 is fetched for user e21b563bcbe04b07b281e7bd6385bab8. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:00:18 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e182f5-81ba-45ce-92f0-ee115a66a439]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:18 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD Jul 08 11:00:18 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:18 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.info" returned: 0 in 0.673s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.520s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-634b9ef1-8bd1-4ab8-80f9-95d074e6a3c0 tempest-VolumeDependencyTests-51471643 None] Create snapshot completed successfully Jul 08 11:00:19 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:19 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD Jul 08 11:00:19 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:19 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD" returned: 1 in 0.775s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1edad66e-b5a1-4c01-af9f-9a4917becb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c273ae4460444128957201207258a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:16Z,use_quota=True,user_id='e21b563bcbe04b07b281e7bd6385bab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1398d3e2-6ca2-4171-a897-a23dbe50f33f),volume_type_id=1398d3e2-6ca2-4171-a897-a23dbe50f33f)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Creating volume 1edad66e-b5a1-4c01-af9f-9a4917becb1e {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:00:19 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:00:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:19 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e 1073741824 Jul 08 11:00:19 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Flow 'volume_create_manager' (9eb9b58f-6ae9-4472-be57-a2a571b23234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d922493-1dd5-4732-9052-cf3eba483d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d922493-1dd5-4732-9052-cf3eba483d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1227278683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc49a9a4-4244-427f-bd9c-62c40e1df5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27053feb6e64415b39929637c8f6d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=037a0011-9dfd-4a6d-bef9-2a0742c64592,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:20Z,use_quota=True,user_id='c23c2f11715f4b3a88f13c4c5891dcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59001a2d-1778-4775-a231-caadbf66b4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59001a2d-1778-4775-a231-caadbf66b4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9eb881-b281-4587-9e69-c0387b5b3bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9eb881-b281-4587-9e69-c0387b5b3bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc49a9a4-4244-427f-bd9c-62c40e1df5a9', 'volume_name': 'volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9', 'volume_size': 1, 'snapshot_id': '037a0011-9dfd-4a6d-bef9-2a0742c64592'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd76f63-2c6e-4887-af2c-52d3f8661e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd76f63-2c6e-4887-af2c-52d3f8661e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96a81d2-e6fc-45c8-8d08-ff69cd0a1ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:20 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Volume dc49a9a4-4244-427f-bd9c-62c40e1df5a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9', 'volume_size': 1, 'snapshot_id': '037a0011-9dfd-4a6d-bef9-2a0742c64592'} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:20 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e 1073741824" returned: 0 in 0.908s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:20 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e Jul 08 11:00:20 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:21 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e" returned: 0 in 0.656s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.198s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Acquiring lock "cinder-quobyte-037a0011-9dfd-4a6d-bef9-2a0742c64592-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" by "_create_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-037a0011-9dfd-4a6d-bef9-2a0742c64592-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Creating volume dc49a9a4-4244-427f-bd9c-62c40e1df5a9 from snapshot 037a0011-9dfd-4a6d-bef9-2a0742c64592 {{(pid=86913) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Acquiring lock "cinder-quobyte-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Attempting download of ff137e27-fbbd-4b53-9f12-78296ea52487 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff137e27-fbbd-4b53-9f12-78296ea52487', 'metadata': {}}])) to volume 1edad66e-b5a1-4c01-af9f-9a4917becb1e. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] snapshot: 037a0011-9dfd-4a6d-bef9-2a0742c64592, volume: dc49a9a4-4244-427f-bd9c-62c40e1df5a9, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22d074c-5326-4649-8513-8892fd85010d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecda867-526e-41a2-a2d5-92f4818ec85b]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff137e27-fbbd-4b53-9f12-78296ea52487_q4u7_x8_ {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:21 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 Jul 08 11:00:21 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:21 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff137e27-fbbd-4b53-9f12-78296ea52487_q4u7_x8_ Jul 08 11:00:21 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:22 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff137e27-fbbd-4b53-9f12-78296ea52487_q4u7_x8_" returned: 0 in 0.752s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:22 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff137e27-fbbd-4b53-9f12-78296ea52487_q4u7_x8_ {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592" returned: 0 in 0.777s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf194f0e-7a45-4274-8f11-227b59177c8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:00:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:00:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:00:22 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecc09d8-8e9d-419d-aa56-53097ee7b9bd]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:22 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff137e27-fbbd-4b53-9f12-78296ea52487_q4u7_x8_ Jul 08 11:00:22 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:22 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d Jul 08 11:00:22 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:23 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff137e27-fbbd-4b53-9f12-78296ea52487_q4u7_x8_" returned: 1 in 0.722s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff137e27-fbbd-4b53-9f12-78296ea52487_q4u7_x8_' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:00:23 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0d2188-549a-4d02-afe7-fcff078d2f39]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:23 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d" returned: 0 in 0.740s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:23 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:00:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:23 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 Jul 08 11:00:23 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:23 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD Jul 08 11:00:23 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:23 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:24 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD Jul 08 11:00:24 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:25 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD" returned: 1 in 1.660s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:00:25 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] ff137e27-fbbd-4b53-9f12-78296ea52487 was raw, converting to raw {{(pid=86913) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:00:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:25 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e Jul 08 11:00:25 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:27 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e" returned: 0 in 2.009s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:27 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ff137e27-fbbd-4b53-9f12-78296ea52487_yvujc85kdevstack@QuobyteHD, size 0.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:00:27 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 11:00:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:27 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e 1G Jul 08 11:00:27 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:28 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" returned: 0 in 4.995s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:28 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3752663-ce5a-41b7-acf4-36ae27df8731]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:28 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d Jul 08 11:00:28 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:28 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e 1G" returned: 0 in 0.916s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:28 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0bad09-6c09-4806-b6c9-0749a93086b7]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:28 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e Jul 08 11:00:28 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:29 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d" returned: 0 in 0.931s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:00:29 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Converted 1024.00 MB image at 204.94 MB/s Jul 08 11:00:29 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 is being set with open permissions: ugo+rw Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:29 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 Jul 08 11:00:29 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:29 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e" returned: 0 in 0.761s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:29 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e Jul 08 11:00:29 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:29 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" returned: 0 in 0.669s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" released by "_copy_volume_from_snapshot" :: held 8.221s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-037a0011-9dfd-4a6d-bef9-2a0742c64592-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" released by "_create_volume_from_snapshot" :: held 8.253s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.276s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96a81d2-e6fc-45c8-8d08-ff69cd0a1ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9', 'volume_size': 1, 'snapshot_id': '037a0011-9dfd-4a6d-bef9-2a0742c64592'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef586d6-83fb-4189-8f6f-06fe51c53926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:29 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Volume volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 (dc49a9a4-4244-427f-bd9c-62c40e1df5a9): created successfully Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef586d6-83fb-4189-8f6f-06fe51c53926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Flow 'volume_create_manager' (9eb9b58f-6ae9-4472-be57-a2a571b23234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5ec4e0c7-67e1-48f1-87be-4049bad3e05a tempest-VolumeDependencyTests-51471643 None] Created volume successfully. Jul 08 11:00:30 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e" returned: 1 in 0.741s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Downloaded image ff137e27-fbbd-4b53-9f12-78296ea52487 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff137e27-fbbd-4b53-9f12-78296ea52487', 'metadata': {}}])) to volume 1edad66e-b5a1-4c01-af9f-9a4917becb1e successfully. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Temporary image ff137e27-fbbd-4b53-9f12-78296ea52487 for user e21b563bcbe04b07b281e7bd6385bab8 is deleted. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Marking volume 1edad66e-b5a1-4c01-af9f-9a4917becb1e as bootable. {{(pid=86913) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Copying metadata from image ff137e27-fbbd-4b53-9f12-78296ea52487 to 1edad66e-b5a1-4c01-af9f-9a4917becb1e. {{(pid=86913) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Creating volume glance metadata for volume 1edad66e-b5a1-4c01-af9f-9a4917becb1e backed by image ff137e27-fbbd-4b53-9f12-78296ea52487 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ff137e27-fbbd-4b53-9f12-78296ea52487', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6593ba5cd9da3fcadaf77df628cdd4bd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86913) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Acquiring lock "cinder-037a0011-9dfd-4a6d-bef9-2a0742c64592-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Lock "cinder-037a0011-9dfd-4a6d-bef9-2a0742c64592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Acquiring lock "cinder-quobyte-cf194f0e-7a45-4274-8f11-227b59177c8d" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-cf194f0e-7a45-4274-8f11-227b59177c8d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Acquiring lock "cinder-quobyte-037a0011-9dfd-4a6d-bef9-2a0742c64592" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-037a0011-9dfd-4a6d-bef9-2a0742c64592" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Deleting offline snapshot 037a0011-9dfd-4a6d-bef9-2a0742c64592 of volume cf194f0e-7a45-4274-8f11-227b59177c8d {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] snapshot_file for this snap is: volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c42176f-b1d1-4aef-af37-ca0e2a19f33f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbd4eae-fa24-4d27-98c1-32033e8d4734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e', 'volume_size': 1, 'image_id': 'ff137e27-fbbd-4b53-9f12-78296ea52487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff137e27-fbbd-4b53-9f12-78296ea52487', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6593ba5cd9da3fcadaf77df628cdd4bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c273ae4460444128957201207258a9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b159b02e410484aaf677df480988541271629738b1afd3b0813776c4e134e47d5dc6411dc28335fa1515219deecc00451a978a06e6b844d6101f82b6433ed5d9', 'id': 'ff137e27-fbbd-4b53-9f12-78296ea52487', 'created_at': datetime.datetime(2026, 7, 8, 9, 0, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 0, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff137e27-fbbd-4b53-9f12-78296ea52487/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554c87a5-e4f1-4fc2-9cfd-6d2ea0c261c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:30 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Volume volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e (1edad66e-b5a1-4c01-af9f-9a4917becb1e): created successfully Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554c87a5-e4f1-4fc2-9cfd-6d2ea0c261c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Flow 'volume_create_manager' (7d1822b5-c0df-4dac-8652-1cb3797cdd45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:30 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5e98b0e7-f243-4ffa-ae1f-dee75ee7dbdb tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Created volume successfully. Jul 08 11:00:30 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 Jul 08 11:00:30 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Acquiring lock "cinder-1edad66e-b5a1-4c01-af9f-9a4917becb1e-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Lock "cinder-1edad66e-b5a1-4c01-af9f-9a4917becb1e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Acquiring lock "cinder-quobyte-1edad66e-b5a1-4c01-af9f-9a4917becb1e" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Lock "cinder-quobyte-1edad66e-b5a1-4c01-af9f-9a4917becb1e" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca2a6b5-ea81-4849-9195-36b5d725e976]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:30 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e Jul 08 11:00:30 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:30 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592" returned: 0 in 0.804s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf194f0e-7a45-4274-8f11-227b59177c8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:00:31 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b222956-8b1e-4e95-a559-579a278f0838]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:31 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d Jul 08 11:00:31 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:31 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e" returned: 0 in 0.775s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:31 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e Jul 08 11:00:31 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:31 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d" returned: 0 in 0.836s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:31 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 Jul 08 11:00:31 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:31 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e" returned: 1 in 0.737s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:00:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:32 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e Jul 08 11:00:32 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:32 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592" returned: 0 in 0.748s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:32 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:32 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592 Jul 08 11:00:32 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1edad66e-b5a1-4c01-af9f-9a4917becb1e" returned: 0 in 0.647s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Lock "cinder-quobyte-1edad66e-b5a1-4c01-af9f-9a4917becb1e" released by "delete_volume" :: held 2.227s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:32 devstack cinder-volume[86913]: WARNING cinder.quota [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:00:32 devstack cinder-volume[86913]: WARNING cinder.quota [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:00:32 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Created reservations ['cb36cc63-d1ff-47f9-b17c-c50347e97e77', '39dad3d0-26c9-4206-bd7a-9018d926bb98', '1af28f92-2f33-47a2-9af4-9486ffc6b355', 'f7d378a8-c01a-4f2b-8c2d-197d3331aed4'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:00:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:32 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:00:32 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:33 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d.037a0011-9dfd-4a6d-bef9-2a0742c64592" returned: 0 in 0.661s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-037a0011-9dfd-4a6d-bef9-2a0742c64592" released by "_delete_snapshot" :: held 3.157s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-cf194f0e-7a45-4274-8f11-227b59177c8d" released by "delete_snapshot" :: held 3.187s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:33 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Created reservations ['c63b321c-42ba-4696-ba52-fc9c6b3611d5', '76d6f790-24c3-4e0b-9912-1ebbd654bf01', 'fe7894ee-5690-46c0-a391-dc777b356cb5', 'fa9a35db-3302-4644-9565-3d4239cf8984'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:00:33 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:33 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Delete snapshot completed successfully. Jul 08 11:00:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.650s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:33 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:00:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59904f64-06ae-4e28-8063-71a0aee7499d tempest-VolumeDependencyTests-51471643 None] Lock "cinder-037a0011-9dfd-4a6d-bef9-2a0742c64592-delete_snapshot" released by "delete_snapshot" :: held 3.337s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:33 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Deleted volume successfully. Jul 08 11:00:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f9f2ce0d-dd0e-44e6-8f2e-077d915a2288 tempest-VolumeAndVolumeTypeFromImageTest-1298315477 None] Lock "cinder-1edad66e-b5a1-4c01-af9f-9a4917becb1e-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Acquiring lock "cinder-cf194f0e-7a45-4274-8f11-227b59177c8d-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Lock "cinder-cf194f0e-7a45-4274-8f11-227b59177c8d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Acquiring lock "cinder-quobyte-cf194f0e-7a45-4274-8f11-227b59177c8d" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-cf194f0e-7a45-4274-8f11-227b59177c8d" acquired by "delete_volume" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:34 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace423f1-f407-4e5f-877c-ea1fad0d727f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:34 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d Jul 08 11:00:34 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:35 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d" returned: 0 in 0.834s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:35 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d Jul 08 11:00:35 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:35 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-cf194f0e-7a45-4274-8f11-227b59177c8d" returned: 0 in 0.682s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-cf194f0e-7a45-4274-8f11-227b59177c8d" released by "delete_volume" :: held 1.578s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Created reservations ['2c8f8de1-4690-4988-8a12-89278a02475b', '1574be28-faea-4359-b822-bd8d5c89cf63', '95f416f8-14d1-493b-95d3-3f6b8f0b3f90', '2a3999cc-27ad-4635-baf0-8928f1445174'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:36 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:00:36 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Acquiring lock "cinder-dc49a9a4-4244-427f-bd9c-62c40e1df5a9-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Lock "cinder-dc49a9a4-4244-427f-bd9c-62c40e1df5a9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Acquiring lock "cinder-quobyte-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" acquired by "delete_volume" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32d448d-aa64-487a-9eed-1e6503c14a94]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:36 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.667s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:00:36 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Deleted volume successfully. Jul 08 11:00:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-eae62170-29d1-4c86-8c58-0552c24dbcb3 tempest-VolumeDependencyTests-51471643 None] Lock "cinder-cf194f0e-7a45-4274-8f11-227b59177c8d-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:36 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 Jul 08 11:00:36 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:37 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" returned: 0 in 0.780s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:37 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9 Jul 08 11:00:37 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Flow 'volume_create_manager' (4fb435ba-52fc-421a-8e1a-17d6a792f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221cec32-f0bf-4f2e-adf5-c0c816575419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221cec32-f0bf-4f2e-adf5-c0c816575419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1149389382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52142ed-574a-4250-aa68-2fa8ef761707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547a5fe244c64e2db89b6c2e2fdb9c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:38Z,use_quota=True,user_id='7939911cdafb414b84c4b231c8916b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd9926d-6ed9-4464-be94-d9dc23ef6156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd9926d-6ed9-4464-be94-d9dc23ef6156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8798e22e-cba9-47d7-874d-4f0c054620ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8798e22e-cba9-47d7-874d-4f0c054620ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b52142ed-574a-4250-aa68-2fa8ef761707', 'volume_name': 'volume-b52142ed-574a-4250-aa68-2fa8ef761707', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee88b03-fd7a-46c2-86a0-13cfede6fa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee88b03-fd7a-46c2-86a0-13cfede6fa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6a92c5-5b5e-4101-b095-6f816a2c0a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Volume b52142ed-574a-4250-aa68-2fa8ef761707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b52142ed-574a-4250-aa68-2fa8ef761707', 'volume_size': 1} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1149389382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52142ed-574a-4250-aa68-2fa8ef761707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547a5fe244c64e2db89b6c2e2fdb9c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:38Z,use_quota=True,user_id='7939911cdafb414b84c4b231c8916b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Creating volume b52142ed-574a-4250-aa68-2fa8ef761707 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:00:38 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:38 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707 1073741824 Jul 08 11:00:38 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:38 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" returned: 0 in 0.675s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Lock "cinder-quobyte-dc49a9a4-4244-427f-bd9c-62c40e1df5a9" released by "delete_volume" :: held 1.534s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Created reservations ['0633db5f-0f4e-4c95-9ab6-449163bf9b4d', '9467f649-0393-40a0-b317-97def5ca4227', 'd984c8a1-5114-47a3-b9d4-4efff60f5e82', 'ffc62dda-f723-48b4-8617-23f8affe2e13'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:00:38 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Flow 'volume_create_manager' (42a3b0ae-2090-4f26-a18a-6d4788c1f0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:38 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05af9aff-6c0e-4505-957b-35a00ac2fae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05af9aff-6c0e-4505-957b-35a00ac2fae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1022230624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cf578c-3d81-445c-9713-148b4f06105e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547a5fe244c64e2db89b6c2e2fdb9c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:38Z,use_quota=True,user_id='7939911cdafb414b84c4b231c8916b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0695111-523c-407d-b151-c3df3790bcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0695111-523c-407d-b151-c3df3790bcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de39b76-5ef5-4ccb-b641-8eefd14404b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de39b76-5ef5-4ccb-b641-8eefd14404b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7cf578c-3d81-445c-9713-148b4f06105e', 'volume_name': 'volume-f7cf578c-3d81-445c-9713-148b4f06105e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb63599-3634-425a-aa27-6a968f9dc254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb63599-3634-425a-aa27-6a968f9dc254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613554ad-e246-4432-ac04-4e620a59500b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Volume f7cf578c-3d81-445c-9713-148b4f06105e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7cf578c-3d81-445c-9713-148b4f06105e', 'volume_size': 1} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Flow 'volume_create_manager' (27dd0ed2-e7f5-40f1-a27e-34a6e2d6e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2304f156-5ea5-4c45-b9f9-83898b5a1432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2304f156-5ea5-4c45-b9f9-83898b5a1432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462252413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547a5fe244c64e2db89b6c2e2fdb9c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:39Z,use_quota=True,user_id='7939911cdafb414b84c4b231c8916b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5adeee2-d3a9-48c2-b2c7-fbf609be5242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5adeee2-d3a9-48c2-b2c7-fbf609be5242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4587a6-c78f-47de-84e8-bd9a2fa58f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4587a6-c78f-47de-84e8-bd9a2fa58f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1', 'volume_name': 'volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8682059b-e9ac-4d8e-8acf-e8712aa68f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8682059b-e9ac-4d8e-8acf-e8712aa68f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78262cc-0994-4227-ba51-61b539ac2ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:38 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Volume f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1', 'volume_size': 1} Jul 08 11:00:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:39 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707 1073741824" returned: 0 in 1.134s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:39 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.832s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Deleted volume successfully. Jul 08 11:00:39 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707 Jul 08 11:00:39 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e22b4005-440d-45ba-beeb-eb4ca63d53f7 tempest-VolumeDependencyTests-51471643 None] Lock "cinder-dc49a9a4-4244-427f-bd9c-62c40e1df5a9-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Flow 'volume_create_manager' (00e380e3-c5c5-4516-bdad-4b5a7a9e9eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15f5dc3-811e-4b26-a913-4958f3261d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15f5dc3-811e-4b26-a913-4958f3261d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2041308580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9411b60-34eb-4586-a53c-7da0aa260ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547a5fe244c64e2db89b6c2e2fdb9c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:39Z,use_quota=True,user_id='7939911cdafb414b84c4b231c8916b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82a6d4c-732e-4b4c-ab04-4e76aaaae40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82a6d4c-732e-4b4c-ab04-4e76aaaae40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426eb768-9cf3-4f36-aeff-2ecba4442f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426eb768-9cf3-4f36-aeff-2ecba4442f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9411b60-34eb-4586-a53c-7da0aa260ca4', 'volume_name': 'volume-d9411b60-34eb-4586-a53c-7da0aa260ca4', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4915170-9fb9-47d1-952e-73f7238d5641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4915170-9fb9-47d1-952e-73f7238d5641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764cd3bf-c9dc-4476-9e2c-dcebb6162f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:39 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Volume d9411b60-34eb-4586-a53c-7da0aa260ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9411b60-34eb-4586-a53c-7da0aa260ca4', 'volume_size': 1} Jul 08 11:00:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Flow 'volume_create_manager' (2c801c4b-925b-46e1-9289-53eda061cc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d3ab80-8503-4f85-b566-445e5bd63905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d3ab80-8503-4f85-b566-445e5bd63905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-495752232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f0ae5b-7be6-4af4-9710-97e41a3b5b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547a5fe244c64e2db89b6c2e2fdb9c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:40Z,use_quota=True,user_id='7939911cdafb414b84c4b231c8916b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6378c6-cb89-48b1-a061-97b82a901f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6378c6-cb89-48b1-a061-97b82a901f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ebf021-3718-45aa-8eb2-44e6170770a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ebf021-3718-45aa-8eb2-44e6170770a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f0ae5b-7be6-4af4-9710-97e41a3b5b63', 'volume_name': 'volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94834450-2a22-4523-8d4c-9e173c9c0cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94834450-2a22-4523-8d4c-9e173c9c0cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f5df68-46c4-4a8b-8283-7c30016c9f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:40 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Volume 96f0ae5b-7be6-4af4-9710-97e41a3b5b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63', 'volume_size': 1} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:40 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707" returned: 0 in 0.830s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.576s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1022230624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cf578c-3d81-445c-9713-148b4f06105e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547a5fe244c64e2db89b6c2e2fdb9c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:38Z,use_quota=True,user_id='7939911cdafb414b84c4b231c8916b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Creating volume f7cf578c-3d81-445c-9713-148b4f06105e {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:00:40 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6a92c5-5b5e-4101-b095-6f816a2c0a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52142ed-574a-4250-aa68-2fa8ef761707', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:40 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e 1073741824 Jul 08 11:00:40 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d716fea7-4c1c-43e3-ae7d-e23cc5f4c717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:40 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Volume volume-b52142ed-574a-4250-aa68-2fa8ef761707 (b52142ed-574a-4250-aa68-2fa8ef761707): created successfully Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d716fea7-4c1c-43e3-ae7d-e23cc5f4c717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Flow 'volume_create_manager' (4fb435ba-52fc-421a-8e1a-17d6a792f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b1b2d3fe-c3d5-4965-ac19-181af1c8f416 tempest-CreateVolumesFromImageTest-868726379 None] Created volume successfully. Jul 08 11:00:41 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e 1073741824" returned: 0 in 0.887s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:41 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e Jul 08 11:00:41 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:41 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e" returned: 0 in 0.672s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.796s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462252413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547a5fe244c64e2db89b6c2e2fdb9c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:39Z,use_quota=True,user_id='7939911cdafb414b84c4b231c8916b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Creating volume f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:00:41 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:41 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1 1073741824 Jul 08 11:00:41 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613554ad-e246-4432-ac04-4e620a59500b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cf578c-3d81-445c-9713-148b4f06105e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb4e990-4462-4ff3-b5b0-a51adcf74210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:41 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Volume volume-f7cf578c-3d81-445c-9713-148b4f06105e (f7cf578c-3d81-445c-9713-148b4f06105e): created successfully Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb4e990-4462-4ff3-b5b0-a51adcf74210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Flow 'volume_create_manager' (42a3b0ae-2090-4f26-a18a-6d4788c1f0b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:41 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-7f96859c-d6d8-4e6d-a8e2-fc087d3ed15e tempest-CreateVolumesFromImageTest-868726379 None] Created volume successfully. Jul 08 11:00:42 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1 1073741824" returned: 0 in 0.840s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:42 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1 Jul 08 11:00:42 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:43 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1" returned: 0 in 0.644s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.805s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2041308580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9411b60-34eb-4586-a53c-7da0aa260ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547a5fe244c64e2db89b6c2e2fdb9c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:39Z,use_quota=True,user_id='7939911cdafb414b84c4b231c8916b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Creating volume d9411b60-34eb-4586-a53c-7da0aa260ca4 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:00:43 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78262cc-0994-4227-ba51-61b539ac2ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:43 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4 1073741824 Jul 08 11:00:43 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971b30cf-17fb-4c66-b940-d65218ecdae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:43 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Volume volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1 (f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1): created successfully Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971b30cf-17fb-4c66-b940-d65218ecdae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:43 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Flow 'volume_create_manager' (27dd0ed2-e7f5-40f1-a27e-34a6e2d6e46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:43 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-03078cd2-feb5-4d77-b2d5-3dddc8091aea tempest-CreateVolumesFromImageTest-868726379 None] Created volume successfully. Jul 08 11:00:44 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4 1073741824" returned: 0 in 0.786s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:44 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4 Jul 08 11:00:44 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:44 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4" returned: 0 in 0.670s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.645s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-495752232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f0ae5b-7be6-4af4-9710-97e41a3b5b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547a5fe244c64e2db89b6c2e2fdb9c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:00:40Z,use_quota=True,user_id='7939911cdafb414b84c4b231c8916b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Creating volume 96f0ae5b-7be6-4af4-9710-97e41a3b5b63 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:00:44 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:44 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63 1073741824 Jul 08 11:00:44 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764cd3bf-c9dc-4476-9e2c-dcebb6162f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9411b60-34eb-4586-a53c-7da0aa260ca4', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cd81b3-b4fd-4d76-9aec-505e1ec1327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:44 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Volume volume-d9411b60-34eb-4586-a53c-7da0aa260ca4 (d9411b60-34eb-4586-a53c-7da0aa260ca4): created successfully Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cd81b3-b4fd-4d76-9aec-505e1ec1327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Flow 'volume_create_manager' (00e380e3-c5c5-4516-bdad-4b5a7a9e9eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:44 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-96d08138-bf05-4011-9d12-d134b0a2abb8 tempest-CreateVolumesFromImageTest-868726379 None] Created volume successfully. Jul 08 11:00:45 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63 1073741824" returned: 0 in 0.870s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:45 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63 Jul 08 11:00:45 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:46 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63" returned: 0 in 0.669s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f5df68-46c4-4a8b-8283-7c30016c9f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c53947-a2b2-4e72-ba10-db475363b6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:00:46 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Volume volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63 (96f0ae5b-7be6-4af4-9710-97e41a3b5b63): created successfully Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c53947-a2b2-4e72-ba10-db475363b6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Flow 'volume_create_manager' (2c801c4b-925b-46e1-9289-53eda061cc49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:00:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-abf4f003-2995-4bcf-962d-22fbc4aec03b tempest-CreateVolumesFromImageTest-868726379 None] Created volume successfully. Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "cinder-96f0ae5b-7be6-4af4-9710-97e41a3b5b63-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-96f0ae5b-7be6-4af4-9710-97e41a3b5b63-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "cinder-quobyte-96f0ae5b-7be6-4af4-9710-97e41a3b5b63" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-quobyte-96f0ae5b-7be6-4af4-9710-97e41a3b5b63" acquired by "delete_volume" :: waited 0.013s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0959b454-980f-48b6-9dbf-12b308e28796]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:46 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63 Jul 08 11:00:46 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:47 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63" returned: 0 in 0.747s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:47 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63 Jul 08 11:00:47 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:48 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96f0ae5b-7be6-4af4-9710-97e41a3b5b63" returned: 0 in 0.643s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-quobyte-96f0ae5b-7be6-4af4-9710-97e41a3b5b63" released by "delete_volume" :: held 1.430s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=56,cinder:INSERT=22,cinder:UPDATE=78,cinder:DELETE=7 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Created reservations ['ad189fcf-31ff-47a7-83ab-3cd0deb928ec', 'c9ab262d-0608-40c8-9857-b6e1472e051e', 'e939965e-a5f6-4ebc-96ef-e3c2c3620ad9', 'a77728a7-4349-4e2d-8657-e82e128bd072'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:48 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:00:48 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "cinder-d9411b60-34eb-4586-a53c-7da0aa260ca4-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-d9411b60-34eb-4586-a53c-7da0aa260ca4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "cinder-quobyte-d9411b60-34eb-4586-a53c-7da0aa260ca4" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-quobyte-d9411b60-34eb-4586-a53c-7da0aa260ca4" acquired by "delete_volume" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[86765587-71dd-46eb-beef-c6dfcdd28684]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:48 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.733s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:00:48 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Deleted volume successfully. Jul 08 11:00:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c08f520b-e0e9-4002-a6ac-b607f388a3bb tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-96f0ae5b-7be6-4af4-9710-97e41a3b5b63-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:49 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4 Jul 08 11:00:49 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:49 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4" returned: 0 in 0.776s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:49 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4 Jul 08 11:00:49 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:50 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d9411b60-34eb-4586-a53c-7da0aa260ca4" returned: 0 in 0.673s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-quobyte-d9411b60-34eb-4586-a53c-7da0aa260ca4" released by "delete_volume" :: held 1.494s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:50 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Created reservations ['d5dc2150-9167-4b3e-8874-35a7efc58432', '00e6f1a3-b01a-4659-96a5-5a86f9f67694', '85ff6a6a-ad6c-454f-a11e-2eb2d49f74c6', 'cbdfae92-1cd6-4b2c-ab92-e3beaab4c994'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:00:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:50 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:00:50 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "cinder-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "cinder-quobyte-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-quobyte-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:51 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbcb9a2-15b3-45a8-9041-6f1bb72fff6b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:51 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.724s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:51 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:00:51 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Deleted volume successfully. Jul 08 11:00:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-839ded54-f659-4226-af50-c730b6ec7943 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-d9411b60-34eb-4586-a53c-7da0aa260ca4-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:51 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1 Jul 08 11:00:51 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:51 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1" returned: 0 in 0.755s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:51 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1 Jul 08 11:00:51 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:52 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1" returned: 0 in 0.620s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-quobyte-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1" released by "delete_volume" :: held 1.417s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:52 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Created reservations ['5bef8dce-b158-48ee-95fc-9bdf3ddd99f5', '746ebb19-4662-4cee-a768-bbc4c0ac68d0', '8a9ecc56-d461-4a4f-b579-de876ede9e18', 'a8b7d4f8-3170-467d-aad3-a557d8b7c9d9'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:00:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:52 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:00:52 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "cinder-f7cf578c-3d81-445c-9713-148b4f06105e-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-f7cf578c-3d81-445c-9713-148b4f06105e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "cinder-quobyte-f7cf578c-3d81-445c-9713-148b4f06105e" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-quobyte-f7cf578c-3d81-445c-9713-148b4f06105e" acquired by "delete_volume" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:53 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.696s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:00:53 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Deleted volume successfully. Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2275fef4-cd52-4b8b-bd7a-d42d1a3705dc]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c0a64c2d-ad49-4bc1-8e12-123c2bff7f95 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-f6ff7639-3f6a-4ce1-8da5-7e9c69e2aab1-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:53 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e Jul 08 11:00:53 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:53 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:00:53 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:54 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e" returned: 0 in 0.742s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:54 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e Jul 08 11:00:54 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:54 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.648s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:00:54 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f7cf578c-3d81-445c-9713-148b4f06105e" returned: 0 in 0.692s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-quobyte-f7cf578c-3d81-445c-9713-148b4f06105e" released by "delete_volume" :: held 1.479s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Created reservations ['77fa2504-247f-4f4e-9895-4c75a58472fb', '9a08329f-4610-4492-840e-d2ff8893818f', '53cc0fde-231b-49d4-9642-3db23541ed73', '3ff3d1d6-5df4-4c55-9ad3-43c21bf36aa0'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:54 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:00:54 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "cinder-b52142ed-574a-4250-aa68-2fa8ef761707-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-b52142ed-574a-4250-aa68-2fa8ef761707-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "cinder-quobyte-b52142ed-574a-4250-aa68-2fa8ef761707" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:00:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-quobyte-b52142ed-574a-4250-aa68-2fa8ef761707" acquired by "delete_volume" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:00:55 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3cbf47-fead-445d-930b-759d01d3208e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:00:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:55 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.708s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:55 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:00:55 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Deleted volume successfully. Jul 08 11:00:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-97482643-ba2d-48f6-add4-a48a58394dbc tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-f7cf578c-3d81-445c-9713-148b4f06105e-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:55 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707 Jul 08 11:00:55 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:56 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707" returned: 0 in 0.773s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:56 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707 Jul 08 11:00:56 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:56 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-b52142ed-574a-4250-aa68-2fa8ef761707" returned: 0 in 0.666s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-quobyte-b52142ed-574a-4250-aa68-2fa8ef761707" released by "delete_volume" :: held 1.484s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:00:57 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Created reservations ['27064ae0-3203-409b-b08b-1945d66a574b', '3ca5f9bd-da74-4420-895a-951a6c00ccd5', '34e30c11-cc02-483a-929c-6a9b53f85a6d', '2cf699c7-390c-4722-9f9d-69ef7070249e'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:00:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:00:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:00:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:00:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:00:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:00:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:00:57 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:00:57 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:00:57 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Jul 08 11:00:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.651s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:00:57 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:00:57 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Deleted volume successfully. Jul 08 11:00:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-546582f7-81cb-4147-9fe3-483350d1e436 tempest-CreateVolumesFromImageTest-868726379 None] Lock "cinder-b52142ed-574a-4250-aa68-2fa8ef761707-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Flow 'volume_create_manager' (ebe1377e-0116-42ee-b9e9-0742f4d2b22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ec74fb-85ba-485e-8dda-cb1c667dbaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ec74fb-85ba-485e-8dda-cb1c667dbaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d601422a-ea14-473a-ac03-567778f163b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e42ba7e9bdd44258751724b1b0ecfbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:02Z,use_quota=True,user_id='97a70288e26f4346823a0c4b7a938f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a90b0d0-58d9-43e4-ac4b-45944836e56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a90b0d0-58d9-43e4-ac4b-45944836e56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0abdcc-0187-4f71-be55-d33547a8952b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.image.glance [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Creating Keystone auth plugin from conf {{(pid=86913) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0abdcc-0187-4f71-be55-d33547a8952b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd601422a-ea14-473a-ac03-567778f163b7', 'volume_name': 'volume-d601422a-ea14-473a-ac03-567778f163b7', 'volume_size': 1, 'image_id': '74674e37-9da3-49e5-a8ec-7b11cb219d66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74674e37-9da3-49e5-a8ec-7b11cb219d66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c51e250e06ba89aa7a220ffac13480c1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e42ba7e9bdd44258751724b1b0ecfbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '531766b651d45bd471d84abf5e2ff8349563125a9d4d79376a6dbf40055fe75019bf7c0d7b4846e7c9824574df3a6878e724a9128ff08554a3f64ea76acbd9aa', 'id': '74674e37-9da3-49e5-a8ec-7b11cb219d66', 'created_at': datetime.datetime(2026, 7, 8, 9, 1, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 1, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74674e37-9da3-49e5-a8ec-7b11cb219d66/file', 'properties': {}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb1951f-9438-4305-8306-143500830b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb1951f-9438-4305-8306-143500830b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee74746-0377-4705-b30d-4df0a4d89363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:02 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Volume d601422a-ea14-473a-ac03-567778f163b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d601422a-ea14-473a-ac03-567778f163b7', 'volume_size': 1, 'image_id': '74674e37-9da3-49e5-a8ec-7b11cb219d66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74674e37-9da3-49e5-a8ec-7b11cb219d66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c51e250e06ba89aa7a220ffac13480c1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e42ba7e9bdd44258751724b1b0ecfbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '531766b651d45bd471d84abf5e2ff8349563125a9d4d79376a6dbf40055fe75019bf7c0d7b4846e7c9824574df3a6878e724a9128ff08554a3f64ea76acbd9aa', 'id': '74674e37-9da3-49e5-a8ec-7b11cb219d66', 'created_at': datetime.datetime(2026, 7, 8, 9, 1, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 1, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74674e37-9da3-49e5-a8ec-7b11cb219d66/file', 'properties': {}}, 'image_service': } Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Trying to clone d601422a-ea14-473a-ac03-567778f163b7 from image 74674e37-9da3-49e5-a8ec-7b11cb219d66 at location (None, [{'url': 'file:///opt/stack/data/glance/images/74674e37-9da3-49e5-a8ec-7b11cb219d66', 'metadata': {}}]). {{(pid=86913) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:01:02 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Image download 0.00 MB at 0.00 MB/s Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cc16cb-a1db-4c36-8953-f31faaf925b8]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:01:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:02 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD Jul 08 11:01:02 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:03 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD" returned: 0 in 0.724s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:03 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD Jul 08 11:01:03 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:04 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD" returned: 1 in 0.723s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:01:04 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Temporary image 74674e37-9da3-49e5-a8ec-7b11cb219d66 is fetched for user 97a70288e26f4346823a0c4b7a938f0c. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:01:04 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[771ba042-cbca-47e9-b369-9321f45689e6]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:01:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:04 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD Jul 08 11:01:04 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:05 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD" returned: 0 in 0.713s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:05 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD Jul 08 11:01:05 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:05 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD" returned: 1 in 0.701s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d601422a-ea14-473a-ac03-567778f163b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e42ba7e9bdd44258751724b1b0ecfbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:02Z,use_quota=True,user_id='97a70288e26f4346823a0c4b7a938f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Creating volume d601422a-ea14-473a-ac03-567778f163b7 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:01:05 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:01:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:05 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 1073741824 Jul 08 11:01:05 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:06 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 1073741824" returned: 0 in 0.791s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:06 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 Jul 08 11:01:06 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:07 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7" returned: 0 in 0.627s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:01:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:07 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Attempting download of 74674e37-9da3-49e5-a8ec-7b11cb219d66 ((None, [{'url': 'file:///opt/stack/data/glance/images/74674e37-9da3-49e5-a8ec-7b11cb219d66', 'metadata': {}}])) to volume d601422a-ea14-473a-ac03-567778f163b7. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:01:07 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33873dc-10c4-44c3-bbc2-d424c925c2ae]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:01:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74674e37-9da3-49e5-a8ec-7b11cb219d66_7gp0399g {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:07 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74674e37-9da3-49e5-a8ec-7b11cb219d66_7gp0399g Jul 08 11:01:07 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:07 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74674e37-9da3-49e5-a8ec-7b11cb219d66_7gp0399g" returned: 0 in 0.707s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74674e37-9da3-49e5-a8ec-7b11cb219d66_7gp0399g {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:08 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74674e37-9da3-49e5-a8ec-7b11cb219d66_7gp0399g Jul 08 11:01:08 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:08 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74674e37-9da3-49e5-a8ec-7b11cb219d66_7gp0399g" returned: 1 in 0.697s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74674e37-9da3-49e5-a8ec-7b11cb219d66_7gp0399g' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:01:08 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e00f631-1078-4869-9e81-2bfaa6bd2b3d]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:01:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:08 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD Jul 08 11:01:08 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:09 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD" returned: 0 in 0.691s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:09 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD Jul 08 11:01:09 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:10 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD" returned: 1 in 0.709s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:01:10 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] 74674e37-9da3-49e5-a8ec-7b11cb219d66 was raw, converting to raw {{(pid=86913) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:01:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:10 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 Jul 08 11:01:10 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:10 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7" returned: 0 in 0.702s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:10 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_74674e37-9da3-49e5-a8ec-7b11cb219d66_3anijcb2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:01:10 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 11:01:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:10 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 1G Jul 08 11:01:10 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:11 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 1G" returned: 0 in 0.641s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:11 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[57defaeb-ed47-421c-9177-d7ee255a2614]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:01:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:11 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 Jul 08 11:01:11 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:12 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7" returned: 0 in 0.716s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:12 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 Jul 08 11:01:12 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:12 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7" returned: 1 in 0.759s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:01:12 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Downloaded image 74674e37-9da3-49e5-a8ec-7b11cb219d66 ((None, [{'url': 'file:///opt/stack/data/glance/images/74674e37-9da3-49e5-a8ec-7b11cb219d66', 'metadata': {}}])) to volume d601422a-ea14-473a-ac03-567778f163b7 successfully. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:01:12 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Temporary image 74674e37-9da3-49e5-a8ec-7b11cb219d66 for user 97a70288e26f4346823a0c4b7a938f0c is deleted. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:01:12 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Marking volume d601422a-ea14-473a-ac03-567778f163b7 as bootable. {{(pid=86913) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:01:12 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Copying metadata from image 74674e37-9da3-49e5-a8ec-7b11cb219d66 to d601422a-ea14-473a-ac03-567778f163b7. {{(pid=86913) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:01:12 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Creating volume glance metadata for volume d601422a-ea14-473a-ac03-567778f163b7 backed by image 74674e37-9da3-49e5-a8ec-7b11cb219d66 with: {'image_id': '74674e37-9da3-49e5-a8ec-7b11cb219d66', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c51e250e06ba89aa7a220ffac13480c1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86913) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:01:12 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=93,cinder:SELECT=90,cinder:DELETE=8,cinder:INSERT=26 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:01:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee74746-0377-4705-b30d-4df0a4d89363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d601422a-ea14-473a-ac03-567778f163b7', 'volume_size': 1, 'image_id': '74674e37-9da3-49e5-a8ec-7b11cb219d66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74674e37-9da3-49e5-a8ec-7b11cb219d66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c51e250e06ba89aa7a220ffac13480c1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e42ba7e9bdd44258751724b1b0ecfbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '531766b651d45bd471d84abf5e2ff8349563125a9d4d79376a6dbf40055fe75019bf7c0d7b4846e7c9824574df3a6878e724a9128ff08554a3f64ea76acbd9aa', 'id': '74674e37-9da3-49e5-a8ec-7b11cb219d66', 'created_at': datetime.datetime(2026, 7, 8, 9, 1, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 1, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74674e37-9da3-49e5-a8ec-7b11cb219d66/file', 'properties': {}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8d351d-b209-4884-8046-ca158459bc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:13 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Volume volume-d601422a-ea14-473a-ac03-567778f163b7 (d601422a-ea14-473a-ac03-567778f163b7): created successfully Jul 08 11:01:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8d351d-b209-4884-8046-ca158459bc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Flow 'volume_create_manager' (ebe1377e-0116-42ee-b9e9-0742f4d2b22b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:13 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-364bb488-a0a0-4d90-b25a-2c5eada93556 tempest-VolumeImageDependencyTests-1095200408 None] Created volume successfully. Jul 08 11:01:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Acquiring lock "cinder-d601422a-ea14-473a-ac03-567778f163b7-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:01:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Lock "cinder-d601422a-ea14-473a-ac03-567778f163b7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:01:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Acquiring lock "cinder-quobyte-d601422a-ea14-473a-ac03-567778f163b7" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:01:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Lock "cinder-quobyte-d601422a-ea14-473a-ac03-567778f163b7" acquired by "delete_volume" :: waited 0.013s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:01:14 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8faa93-9f28-4327-9240-99d583feb3f9]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:01:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:14 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 Jul 08 11:01:14 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:14 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7" returned: 0 in 0.727s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:15 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 Jul 08 11:01:15 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:15 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7" returned: 1 in 0.731s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:01:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:15 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7 Jul 08 11:01:15 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:16 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d601422a-ea14-473a-ac03-567778f163b7" returned: 0 in 0.655s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Lock "cinder-quobyte-d601422a-ea14-473a-ac03-567778f163b7" released by "delete_volume" :: held 2.172s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:01:16 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Created reservations ['9ea0d0f1-1d6e-400c-a024-f31414602ace', 'bbaecede-c63b-47df-86cf-7ad5fc0036cf', 'ea6e941f-550c-4397-85bf-4e24fe1889fb', '11da818e-e74d-4dae-8da5-65e0863a3819'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:01:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:16 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:01:16 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:17 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.661s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:17 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:01:17 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Deleted volume successfully. Jul 08 11:01:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-63d08bfc-06ab-4adb-b210-f1660ac3b9f0 tempest-VolumeImageDependencyTests-1095200408 None] Lock "cinder-d601422a-ea14-473a-ac03-567778f163b7-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:01:24 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Flow 'volume_create_manager' (b9f079f0-26e3-430a-9112-495006be8241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b02380-292d-44c1-8519-2564f428efb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b02380-292d-44c1-8519-2564f428efb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003974236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fe70f0-aa58-4971-8e95-507e3e9840f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859ceb9f87304d569d29590402dfb9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:25Z,use_quota=True,user_id='64724bffca2e4aaf981ae90d5c531a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4695591-ddfc-4836-a113-8372e2bbd548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4695591-ddfc-4836-a113-8372e2bbd548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b17eddd-cbcf-40c0-a517-a767cc70103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b17eddd-cbcf-40c0-a517-a767cc70103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26fe70f0-aa58-4971-8e95-507e3e9840f8', 'volume_name': 'volume-26fe70f0-aa58-4971-8e95-507e3e9840f8', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbba8cf-77ed-4475-92c4-940d68f09a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbba8cf-77ed-4475-92c4-940d68f09a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b20c22-7be3-4335-b0a2-0ff12784ca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:25 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Volume 26fe70f0-aa58-4971-8e95-507e3e9840f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26fe70f0-aa58-4971-8e95-507e3e9840f8', 'volume_size': 1} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003974236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fe70f0-aa58-4971-8e95-507e3e9840f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859ceb9f87304d569d29590402dfb9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:25Z,use_quota=True,user_id='64724bffca2e4aaf981ae90d5c531a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Creating volume 26fe70f0-aa58-4971-8e95-507e3e9840f8 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:01:25 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:25 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8 1073741824 Jul 08 11:01:25 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:25 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8 1073741824" returned: 0 in 0.847s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:25 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8 Jul 08 11:01:25 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:26 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8" returned: 0 in 0.641s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:01:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b20c22-7be3-4335-b0a2-0ff12784ca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fe70f0-aa58-4971-8e95-507e3e9840f8', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45117c64-7b4d-4511-bb5b-2431c40cfc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:26 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Volume volume-26fe70f0-aa58-4971-8e95-507e3e9840f8 (26fe70f0-aa58-4971-8e95-507e3e9840f8): created successfully Jul 08 11:01:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45117c64-7b4d-4511-bb5b-2431c40cfc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Flow 'volume_create_manager' (b9f079f0-26e3-430a-9112-495006be8241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:26 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a93227a2-a924-4089-be05-38d7fcd80941 tempest-ProjectReaderTests-2109320839 None] Created volume successfully. Jul 08 11:01:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "cinder-26fe70f0-aa58-4971-8e95-507e3e9840f8-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:01:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-26fe70f0-aa58-4971-8e95-507e3e9840f8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:01:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "cinder-quobyte-26fe70f0-aa58-4971-8e95-507e3e9840f8" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:01:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-quobyte-26fe70f0-aa58-4971-8e95-507e3e9840f8" acquired by "delete_volume" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:01:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d392ff-df6f-4d78-8780-5546844225c1]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:01:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:27 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8 Jul 08 11:01:27 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:27 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8" returned: 0 in 0.728s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:28 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8 Jul 08 11:01:28 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:28 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-26fe70f0-aa58-4971-8e95-507e3e9840f8" returned: 0 in 0.634s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-quobyte-26fe70f0-aa58-4971-8e95-507e3e9840f8" released by "delete_volume" :: held 1.401s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:01:28 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Created reservations ['95938390-f578-41f4-b850-abfcde329f72', '2162bc21-612e-41d0-a288-33feb8494d21', '47ae0ea8-53b6-4fb7-b1e8-de9888390c94', 'd09c7789-c86c-4197-acc6-7ab00d4bbebf'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:01:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:28 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:28 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:01:28 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:29 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.630s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:01:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Deleted volume successfully. Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4e25760f-ae0a-49d9-91f8-ea2676e12aa4 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-26fe70f0-aa58-4971-8e95-507e3e9840f8-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Flow 'volume_create_manager' (62aca11a-ca9c-4ed3-a60d-b52e919b94fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd3abe5-0bc5-47e6-9c58-518182aa2202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd3abe5-0bc5-47e6-9c58-518182aa2202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877521113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acb9cc9-f806-41bd-a435-27ddc6775e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859ceb9f87304d569d29590402dfb9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:30Z,use_quota=True,user_id='64724bffca2e4aaf981ae90d5c531a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8433a76-9586-4efe-9218-582c369ce225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8433a76-9586-4efe-9218-582c369ce225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c35b016-0082-40a5-8031-077d485a1116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c35b016-0082-40a5-8031-077d485a1116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9acb9cc9-f806-41bd-a435-27ddc6775e15', 'volume_name': 'volume-9acb9cc9-f806-41bd-a435-27ddc6775e15', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146da5b2-9536-4fbc-8b2f-1d1ccca18149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146da5b2-9536-4fbc-8b2f-1d1ccca18149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8a1907-78ed-47b3-a3dd-fb3ab5f5718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:29 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Volume 9acb9cc9-f806-41bd-a435-27ddc6775e15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9acb9cc9-f806-41bd-a435-27ddc6775e15', 'volume_size': 1} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877521113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acb9cc9-f806-41bd-a435-27ddc6775e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859ceb9f87304d569d29590402dfb9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:30Z,use_quota=True,user_id='64724bffca2e4aaf981ae90d5c531a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Creating volume 9acb9cc9-f806-41bd-a435-27ddc6775e15 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:01:29 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:01:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:29 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15 1073741824 Jul 08 11:01:29 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:30 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15 1073741824" returned: 0 in 0.777s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:30 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15 Jul 08 11:01:30 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:31 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15" returned: 0 in 0.619s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:01:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8a1907-78ed-47b3-a3dd-fb3ab5f5718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9acb9cc9-f806-41bd-a435-27ddc6775e15', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0104fdff-493a-4295-a6bf-a77ca645c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:31 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Volume volume-9acb9cc9-f806-41bd-a435-27ddc6775e15 (9acb9cc9-f806-41bd-a435-27ddc6775e15): created successfully Jul 08 11:01:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0104fdff-493a-4295-a6bf-a77ca645c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Flow 'volume_create_manager' (62aca11a-ca9c-4ed3-a60d-b52e919b94fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:31 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ac820e56-1a88-4f0f-b475-a271adae9444 tempest-ProjectReaderTests-2109320839 None] Created volume successfully. Jul 08 11:01:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Acquiring lock "cinder-9acb9cc9-f806-41bd-a435-27ddc6775e15-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:01:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Lock "cinder-9acb9cc9-f806-41bd-a435-27ddc6775e15-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:01:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Acquiring lock "cinder-quobyte-9acb9cc9-f806-41bd-a435-27ddc6775e15" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:01:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Lock "cinder-quobyte-9acb9cc9-f806-41bd-a435-27ddc6775e15" acquired by "delete_volume" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:01:32 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b37f8d-3f8b-4da9-a9b4-be2f64f0e7af]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:01:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:32 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15 Jul 08 11:01:32 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:32 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15" returned: 0 in 0.733s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:32 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15 Jul 08 11:01:32 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:33 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9acb9cc9-f806-41bd-a435-27ddc6775e15" returned: 0 in 0.666s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Lock "cinder-quobyte-9acb9cc9-f806-41bd-a435-27ddc6775e15" released by "delete_volume" :: held 1.437s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:01:33 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Created reservations ['f3c29b19-00f8-4973-bd38-19c3c31e3645', '2590445a-e84d-4807-a0a6-7bf8f9dc99b8', '96c88ef6-403b-4a53-8b73-6b7f85d53c72', 'f70072f7-9e8f-498f-90d3-9f186111f19c'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:01:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:33 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:01:33 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:34 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.648s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:01:34 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Deleted volume successfully. Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42405efa-6576-4946-bd98-6c8ef16d672a tempest-ProjectReaderTests-2109320839 None] Lock "cinder-9acb9cc9-f806-41bd-a435-27ddc6775e15-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Flow 'volume_create_manager' (7d52e95c-e823-4065-9952-8b97396f2a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083d610c-14e7-4a53-891a-cf4ee36dfe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083d610c-14e7-4a53-891a-cf4ee36dfe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836296442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52031095-8716-43b7-8857-ec238aa80b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859ceb9f87304d569d29590402dfb9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:35Z,use_quota=True,user_id='64724bffca2e4aaf981ae90d5c531a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d463c1b-2436-4940-922b-0c290f1b3d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d463c1b-2436-4940-922b-0c290f1b3d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0dd681-1720-45dc-9530-8912da65080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0dd681-1720-45dc-9530-8912da65080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52031095-8716-43b7-8857-ec238aa80b54', 'volume_name': 'volume-52031095-8716-43b7-8857-ec238aa80b54', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23aadaa-d3ad-4005-b6a3-6f06c5ca7d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23aadaa-d3ad-4005-b6a3-6f06c5ca7d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726aa3b3-45b6-4bf1-87ad-1cc04ba1994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:34 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Volume 52031095-8716-43b7-8857-ec238aa80b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52031095-8716-43b7-8857-ec238aa80b54', 'volume_size': 1} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836296442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52031095-8716-43b7-8857-ec238aa80b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859ceb9f87304d569d29590402dfb9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:35Z,use_quota=True,user_id='64724bffca2e4aaf981ae90d5c531a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Creating volume 52031095-8716-43b7-8857-ec238aa80b54 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:01:34 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:01:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:34 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54 1073741824 Jul 08 11:01:34 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:35 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54 1073741824" returned: 0 in 0.792s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:35 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54 Jul 08 11:01:35 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:36 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54" returned: 0 in 0.641s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726aa3b3-45b6-4bf1-87ad-1cc04ba1994b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52031095-8716-43b7-8857-ec238aa80b54', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476dc550-940f-4de8-9957-d0a21fead7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:36 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Volume volume-52031095-8716-43b7-8857-ec238aa80b54 (52031095-8716-43b7-8857-ec238aa80b54): created successfully Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476dc550-940f-4de8-9957-d0a21fead7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Flow 'volume_create_manager' (7d52e95c-e823-4065-9952-8b97396f2a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:36 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b6b26a6f-b370-4e7a-8823-261bea0d2d8d tempest-ProjectReaderTests-2109320839 None] Created volume successfully. Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "cinder-52031095-8716-43b7-8857-ec238aa80b54-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-52031095-8716-43b7-8857-ec238aa80b54-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "cinder-quobyte-52031095-8716-43b7-8857-ec238aa80b54" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-quobyte-52031095-8716-43b7-8857-ec238aa80b54" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eb7525-3356-4593-a963-c5f2de6c1cd7]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:01:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:36 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54 Jul 08 11:01:36 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:37 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54" returned: 0 in 0.734s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:37 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54 Jul 08 11:01:37 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:38 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-52031095-8716-43b7-8857-ec238aa80b54" returned: 0 in 0.624s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-quobyte-52031095-8716-43b7-8857-ec238aa80b54" released by "delete_volume" :: held 1.397s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Created reservations ['6734a86c-a754-459a-88d9-3d9e54156d57', '9f4fe6c3-8fc2-4c76-ba4d-558079b78624', 'fd3101da-602e-41db-aad5-03d030472d0e', '7df4bee9-2666-4725-9e30-03d6101da879'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:38 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:01:38 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:38 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.638s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:01:38 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Deleted volume successfully. Jul 08 11:01:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b14ee944-ba2a-44af-9145-29d151bb5df6 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-52031095-8716-43b7-8857-ec238aa80b54-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Flow 'volume_create_manager' (90b83fc2-b057-4181-81ad-f1096c8a5113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d8b52a-7cc5-4948-9b3c-fb02a6211ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d8b52a-7cc5-4948-9b3c-fb02a6211ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398985300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c9f493-89ef-4876-8978-9770d9c91ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859ceb9f87304d569d29590402dfb9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:39Z,use_quota=True,user_id='64724bffca2e4aaf981ae90d5c531a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ebb1cb-d686-48fb-9444-4e76fba0b9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ebb1cb-d686-48fb-9444-4e76fba0b9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15120e8e-8ce0-4cb0-adb7-fc4e1b2b9358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15120e8e-8ce0-4cb0-adb7-fc4e1b2b9358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c9f493-89ef-4876-8978-9770d9c91ceb', 'volume_name': 'volume-d0c9f493-89ef-4876-8978-9770d9c91ceb', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664d9165-fff5-421a-a3cd-fb92dd35b86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664d9165-fff5-421a-a3cd-fb92dd35b86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6658d973-97fe-4f82-97be-a96f0e7f7173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:39 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Volume d0c9f493-89ef-4876-8978-9770d9c91ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c9f493-89ef-4876-8978-9770d9c91ceb', 'volume_size': 1} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398985300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c9f493-89ef-4876-8978-9770d9c91ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859ceb9f87304d569d29590402dfb9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:39Z,use_quota=True,user_id='64724bffca2e4aaf981ae90d5c531a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Creating volume d0c9f493-89ef-4876-8978-9770d9c91ceb {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:01:39 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:01:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:39 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb 1073741824 Jul 08 11:01:39 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:40 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb 1073741824" returned: 0 in 0.824s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:40 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb Jul 08 11:01:40 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:40 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb" returned: 0 in 0.613s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:01:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6658d973-97fe-4f82-97be-a96f0e7f7173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c9f493-89ef-4876-8978-9770d9c91ceb', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac6bbdf-a4ba-4d98-94e1-c4e1f2186585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:40 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Volume volume-d0c9f493-89ef-4876-8978-9770d9c91ceb (d0c9f493-89ef-4876-8978-9770d9c91ceb): created successfully Jul 08 11:01:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac6bbdf-a4ba-4d98-94e1-c4e1f2186585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Flow 'volume_create_manager' (90b83fc2-b057-4181-81ad-f1096c8a5113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a791aa42-b173-4554-b50e-e273bf0c890d tempest-ProjectReaderTests-2109320839 None] Created volume successfully. Jul 08 11:01:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "cinder-d0c9f493-89ef-4876-8978-9770d9c91ceb-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:01:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-d0c9f493-89ef-4876-8978-9770d9c91ceb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:01:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "cinder-quobyte-d0c9f493-89ef-4876-8978-9770d9c91ceb" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:01:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-quobyte-d0c9f493-89ef-4876-8978-9770d9c91ceb" acquired by "delete_volume" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:01:41 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[7006f06c-2aaf-4313-bcc7-4fcdddffd84b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:01:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:41 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb Jul 08 11:01:41 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:42 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb" returned: 0 in 0.789s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:42 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb Jul 08 11:01:42 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:42 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d0c9f493-89ef-4876-8978-9770d9c91ceb" returned: 0 in 0.659s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-quobyte-d0c9f493-89ef-4876-8978-9770d9c91ceb" released by "delete_volume" :: held 1.487s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:01:43 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Created reservations ['6519b93c-a1fb-407a-b71a-f5cd29093f9c', '4e3e2a07-4c41-4924-aed1-3cb2d2af04b0', '3291c910-a873-42c0-9a2b-64842519852e', '1c3d2d6a-9edd-43d5-94c7-ebc2a7230087'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:01:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:43 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:01:43 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:43 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.632s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:43 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:01:43 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Deleted volume successfully. Jul 08 11:01:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c6d126da-2daf-4504-9962-09d287e97cc0 tempest-ProjectReaderTests-2109320839 None] Lock "cinder-d0c9f493-89ef-4876-8978-9770d9c91ceb-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:01:53 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:INSERT=32,cinder:UPDATE=94,cinder:SELECT=59,cinder:DELETE=10 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:01:53 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=53,cinder:SELECT=32,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:01:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:01:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:53 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:01:53 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:54 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.689s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:01:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:01:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:01:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Flow 'volume_create_manager' (02dafee3-8d5e-4fed-8d59-32f6f11b3436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4aae591-367c-4418-a8b1-8a3cc44d3847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4aae591-367c-4418-a8b1-8a3cc44d3847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343608163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba93fe42-b113-4b75-a4cb-46adc0b2aa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831568649b7e4f57ada6e5e8c40ed8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:56Z,use_quota=True,user_id='ad0424c9c05e476aaee9ca7c884c91ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc8f10b-18af-45ee-b93e-7e4e06ec0d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc8f10b-18af-45ee-b93e-7e4e06ec0d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca0337f-58f0-4afa-b852-75f565405253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca0337f-58f0-4afa-b852-75f565405253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba93fe42-b113-4b75-a4cb-46adc0b2aa63', 'volume_name': 'volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982a19a8-baa4-41fc-a0e5-8748100f2b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982a19a8-baa4-41fc-a0e5-8748100f2b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c4067f-296a-48ab-8e23-8ad146157cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:56 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Volume ba93fe42-b113-4b75-a4cb-46adc0b2aa63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63', 'volume_size': 1} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343608163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba93fe42-b113-4b75-a4cb-46adc0b2aa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831568649b7e4f57ada6e5e8c40ed8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:56Z,use_quota=True,user_id='ad0424c9c05e476aaee9ca7c884c91ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Creating volume ba93fe42-b113-4b75-a4cb-46adc0b2aa63 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:01:56 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:56 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63 1073741824 Jul 08 11:01:56 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Flow 'volume_create_manager' (dc3a7477-e92e-4d34-916f-e3b82fa2ae3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae00bca3-0fa3-411a-a8d7-3dd6b69e19af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae00bca3-0fa3-411a-a8d7-3dd6b69e19af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1438447798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d043c166-a635-4aad-8a26-07722af3d3a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831568649b7e4f57ada6e5e8c40ed8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:57Z,use_quota=True,user_id='ad0424c9c05e476aaee9ca7c884c91ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938aa29e-821b-475f-8a24-8fdfc8e5a9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938aa29e-821b-475f-8a24-8fdfc8e5a9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d4ce35-95af-4a62-b44f-48b1a1ff2b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d4ce35-95af-4a62-b44f-48b1a1ff2b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd043c166-a635-4aad-8a26-07722af3d3a5', 'volume_name': 'volume-d043c166-a635-4aad-8a26-07722af3d3a5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05882f25-144d-4a5a-9634-2e36aa2458a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05882f25-144d-4a5a-9634-2e36aa2458a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd84e5b-980a-4b73-9621-96201d503c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Volume d043c166-a635-4aad-8a26-07722af3d3a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d043c166-a635-4aad-8a26-07722af3d3a5', 'volume_size': 1} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (0bc69aba-4460-4090-ad67-f0dcd30a999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f4f778-6c0d-489c-9d42-584186873413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f4f778-6c0d-489c-9d42-584186873413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021108438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8d7a8b-d148-478d-8000-0c83aeba3007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:57Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed28dbe6-c045-42c2-8645-785e5f788a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed28dbe6-c045-42c2-8645-785e5f788a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8641a598-0b9f-4201-960c-cc0eccc538bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8641a598-0b9f-4201-960c-cc0eccc538bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f8d7a8b-d148-478d-8000-0c83aeba3007', 'volume_name': 'volume-2f8d7a8b-d148-478d-8000-0c83aeba3007', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f4de6d-a581-4264-b66d-f24c3510d511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f4de6d-a581-4264-b66d-f24c3510d511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8e7496-9428-49df-b154-52dc2cf1750d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume 2f8d7a8b-d148-478d-8000-0c83aeba3007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f8d7a8b-d148-478d-8000-0c83aeba3007', 'volume_size': 1} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:57 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63 1073741824" returned: 0 in 1.206s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:57 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63 Jul 08 11:01:57 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Flow 'volume_create_manager' (9976d4d4-a828-44fb-9167-a2a986f3b051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07da869-13d8-4656-bccf-ca45c5a809ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07da869-13d8-4656-bccf-ca45c5a809ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1884185102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d049fe80-3834-4864-a23b-22645e76e4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831568649b7e4f57ada6e5e8c40ed8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:58Z,use_quota=True,user_id='ad0424c9c05e476aaee9ca7c884c91ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71eda89-2a74-484f-b073-4f85d65b473f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71eda89-2a74-484f-b073-4f85d65b473f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922af6d0-ac1c-4327-b3a6-75d4e3ab3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922af6d0-ac1c-4327-b3a6-75d4e3ab3759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd049fe80-3834-4864-a23b-22645e76e4f3', 'volume_name': 'volume-d049fe80-3834-4864-a23b-22645e76e4f3', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d26ef5d-b327-4ebb-923c-8ef71c9ab324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d26ef5d-b327-4ebb-923c-8ef71c9ab324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c2081c-6cf6-4c35-b756-aa3f49f97f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:57 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Volume d049fe80-3834-4864-a23b-22645e76e4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d049fe80-3834-4864-a23b-22645e76e4f3', 'volume_size': 1} Jul 08 11:01:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Flow 'volume_create_manager' (be4d071d-4c3d-4d80-93b7-d1e7e3eda467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e8519d-5b83-401f-b3e5-6f6f61197b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e8519d-5b83-401f-b3e5-6f6f61197b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2092386779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30e2d8b-acd3-4f53-aed1-4c854c11af49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831568649b7e4f57ada6e5e8c40ed8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:58Z,use_quota=True,user_id='ad0424c9c05e476aaee9ca7c884c91ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86295ce9-7f80-4364-9e84-73ca760973ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86295ce9-7f80-4364-9e84-73ca760973ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c307fa3-9bd2-4d8e-926c-2e70984f3457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c307fa3-9bd2-4d8e-926c-2e70984f3457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f30e2d8b-acd3-4f53-aed1-4c854c11af49', 'volume_name': 'volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42717c2a-e789-4fe5-9863-68a88ca2745b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42717c2a-e789-4fe5-9863-68a88ca2745b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae98628-27e8-4558-9484-4cbcfce44a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:58 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Volume f30e2d8b-acd3-4f53-aed1-4c854c11af49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49', 'volume_size': 1} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:58 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63" returned: 0 in 1.010s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.526s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1438447798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d043c166-a635-4aad-8a26-07722af3d3a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831568649b7e4f57ada6e5e8c40ed8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:57Z,use_quota=True,user_id='ad0424c9c05e476aaee9ca7c884c91ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Creating volume d043c166-a635-4aad-8a26-07722af3d3a5 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:01:58 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:58 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5 1073741824 Jul 08 11:01:58 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c4067f-296a-48ab-8e23-8ad146157cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c173977-d946-4f17-b6bc-ebe7ebf3dab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Flow 'volume_create_manager' (c61e14f5-26d7-4b5b-8f17-7d55045f2db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466a62ce-dada-4876-9bdf-0091f6619f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:58 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Volume volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63 (ba93fe42-b113-4b75-a4cb-46adc0b2aa63): created successfully Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c173977-d946-4f17-b6bc-ebe7ebf3dab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Flow 'volume_create_manager' (02dafee3-8d5e-4fed-8d59-32f6f11b3436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466a62ce-dada-4876-9bdf-0091f6619f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1190692648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbb5fdc-c058-4d62-be7f-18d3c7e911e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831568649b7e4f57ada6e5e8c40ed8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:59Z,use_quota=True,user_id='ad0424c9c05e476aaee9ca7c884c91ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c3e38e-1dda-4d85-acec-70a03c60ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c3e38e-1dda-4d85-acec-70a03c60ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5eef087-0760-4fe1-94ab-ff2c4a1b3a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5eef087-0760-4fe1-94ab-ff2c4a1b3a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fbb5fdc-c058-4d62-be7f-18d3c7e911e8', 'volume_name': 'volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedec831-2b86-4cc2-b961-e84363178e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedec831-2b86-4cc2-b961-e84363178e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61cfd59-372d-446f-b601-88c5a7bfe53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:01:58 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Volume 6fbb5fdc-c058-4d62-be7f-18d3c7e911e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8', 'volume_size': 1} Jul 08 11:01:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:01:58 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-bd8bb0cc-9e7f-4451-82dc-95630272f2a9 tempest-CreateVolumesFromImageTest-1466185834 None] Created volume successfully. Jul 08 11:01:59 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 08 11:01:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5 1073741824" returned: 0 in 1.172s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:01:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:01:59 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5 Jul 08 11:01:59 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Flow 'volume_create_manager' (bd4ea207-69a3-4942-89f0-7f6fc7abd0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04ff496-ea90-4b6d-bd55-d9d64a52d877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04ff496-ea90-4b6d-bd55-d9d64a52d877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc11652-ddaa-4894-9b50-74903644683a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b587fe4788e5443abc3b10f9b64ee5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:00Z,use_quota=True,user_id='caba49678bb54e7faa1d10f49fdae198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4310492-9c9c-4a1b-99e5-61008d5a2a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4310492-9c9c-4a1b-99e5-61008d5a2a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e7349c-633d-4777-9334-d00428d6415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.image.glance [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Creating Keystone auth plugin from conf {{(pid=86913) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:02:00 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5" returned: 0 in 0.860s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.410s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021108438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8d7a8b-d148-478d-8000-0c83aeba3007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:57Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Creating volume 2f8d7a8b-d148-478d-8000-0c83aeba3007 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:00 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd84e5b-980a-4b73-9621-96201d503c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d043c166-a635-4aad-8a26-07722af3d3a5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b56c07-5de9-4c93-9d03-7c9ff7f2cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:00 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007 1073741824 Jul 08 11:02:00 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e7349c-633d-4777-9334-d00428d6415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5bc11652-ddaa-4894-9b50-74903644683a', 'volume_name': 'volume-5bc11652-ddaa-4894-9b50-74903644683a', 'volume_size': 1, 'image_id': '293026ad-0ab6-47a3-a90a-71e7796031a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/293026ad-0ab6-47a3-a90a-71e7796031a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3e5395a3b32923be5c5bf7fa437f1c8f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b587fe4788e5443abc3b10f9b64ee5b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60fdbac5a620d79db90c0d8a9423e3b643bec2e776c3bf2212c545dd44ea2f89f6edeaa71a04d9b4b8ea51d76082e7bdbcbdf3e6259348a2671bd15b57ababdc', 'id': '293026ad-0ab6-47a3-a90a-71e7796031a9', 'created_at': datetime.datetime(2026, 7, 8, 9, 1, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 1, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/293026ad-0ab6-47a3-a90a-71e7796031a9/file', 'properties': {}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d27141-ab33-4b01-b8a4-317b090f240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d27141-ab33-4b01-b8a4-317b090f240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5b86a0-6cbf-4418-9afd-199099fcba42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:00 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Volume 5bc11652-ddaa-4894-9b50-74903644683a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5bc11652-ddaa-4894-9b50-74903644683a', 'volume_size': 1, 'image_id': '293026ad-0ab6-47a3-a90a-71e7796031a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/293026ad-0ab6-47a3-a90a-71e7796031a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3e5395a3b32923be5c5bf7fa437f1c8f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b587fe4788e5443abc3b10f9b64ee5b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60fdbac5a620d79db90c0d8a9423e3b643bec2e776c3bf2212c545dd44ea2f89f6edeaa71a04d9b4b8ea51d76082e7bdbcbdf3e6259348a2671bd15b57ababdc', 'id': '293026ad-0ab6-47a3-a90a-71e7796031a9', 'created_at': datetime.datetime(2026, 7, 8, 9, 1, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 1, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/293026ad-0ab6-47a3-a90a-71e7796031a9/file', 'properties': {}}, 'image_service': } Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Trying to clone 5bc11652-ddaa-4894-9b50-74903644683a from image 293026ad-0ab6-47a3-a90a-71e7796031a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/293026ad-0ab6-47a3-a90a-71e7796031a9', 'metadata': {}}]). {{(pid=86913) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:02:00 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Volume volume-d043c166-a635-4aad-8a26-07722af3d3a5 (d043c166-a635-4aad-8a26-07722af3d3a5): created successfully Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b56c07-5de9-4c93-9d03-7c9ff7f2cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Flow 'volume_create_manager' (dc3a7477-e92e-4d34-916f-e3b82fa2ae3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:00 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5bdd63e3-73cd-4275-8620-8af240201691 tempest-CreateVolumesFromImageTest-1466185834 None] Created volume successfully. Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:02:00 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Image download 0.00 MB at 0.00 MB/s Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d89fde7-2d4f-4b98-a756-0c594060c359]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:01 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD Jul 08 11:02:01 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Flow 'volume_create_manager' (6013cf61-f97b-4600-a808-1a3e90c79fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcd1aae-e498-4399-b057-90434888bfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcd1aae-e498-4399-b057-90434888bfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a292b412-bd25-419e-9e6e-737c065d4c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec564858ab5043ef80de60b32740d9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:02Z,use_quota=True,user_id='0faa8c1e4d8b4510be041caa8669ca7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d58ba1f-60e1-4b81-8121-cb576589d34b),volume_type_id=9d58ba1f-60e1-4b81-8121-cb576589d34b)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6227970-8ccf-4ccf-beb7-f437e8db5f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6227970-8ccf-4ccf-beb7-f437e8db5f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3c1a8f-95f1-48da-b412-67fb9152fd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG cinder.image.glance [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Creating Keystone auth plugin from conf {{(pid=86913) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:02:01 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007 1073741824" returned: 0 in 1.051s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:01 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007 Jul 08 11:02:01 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:01 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD" returned: 0 in 0.934s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3c1a8f-95f1-48da-b412-67fb9152fd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a292b412-bd25-419e-9e6e-737c065d4c8c', 'volume_name': 'volume-a292b412-bd25-419e-9e6e-737c065d4c8c', 'volume_size': 1, 'image_id': '65f184cf-8460-49d9-899f-b50d4643ace9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65f184cf-8460-49d9-899f-b50d4643ace9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '839503007092e7f2fd293a1098b283d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec564858ab5043ef80de60b32740d9e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a73080cb46087e7cfc53ba7119458aa923d259b87cfa2a95eb55722c2edcb30742161eeef29526e35ea087c8202b685e90f126242b12881e751d269e1822210', 'id': '65f184cf-8460-49d9-899f-b50d4643ace9', 'created_at': datetime.datetime(2026, 7, 8, 9, 1, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65f184cf-8460-49d9-899f-b50d4643ace9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc33ddd2-965c-4724-a802-74309f811572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc33ddd2-965c-4724-a802-74309f811572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ea9e13-db48-4305-831e-b3a6ff77065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:02 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Volume a292b412-bd25-419e-9e6e-737c065d4c8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a292b412-bd25-419e-9e6e-737c065d4c8c', 'volume_size': 1, 'image_id': '65f184cf-8460-49d9-899f-b50d4643ace9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65f184cf-8460-49d9-899f-b50d4643ace9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '839503007092e7f2fd293a1098b283d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec564858ab5043ef80de60b32740d9e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a73080cb46087e7cfc53ba7119458aa923d259b87cfa2a95eb55722c2edcb30742161eeef29526e35ea087c8202b685e90f126242b12881e751d269e1822210', 'id': '65f184cf-8460-49d9-899f-b50d4643ace9', 'created_at': datetime.datetime(2026, 7, 8, 9, 1, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65f184cf-8460-49d9-899f-b50d4643ace9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Trying to clone a292b412-bd25-419e-9e6e-737c065d4c8c from image 65f184cf-8460-49d9-899f-b50d4643ace9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/65f184cf-8460-49d9-899f-b50d4643ace9', 'metadata': {}}]). {{(pid=86913) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:02:02 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD Jul 08 11:02:02 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:02:02 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Image download 0.00 MB at 0.00 MB/s Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99c7400-0543-4dbb-94ff-b5885b1e9539]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:02 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD Jul 08 11:02:02 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:02 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007" returned: 0 in 0.734s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.806s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1884185102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d049fe80-3834-4864-a23b-22645e76e4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831568649b7e4f57ada6e5e8c40ed8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:58Z,use_quota=True,user_id='ad0424c9c05e476aaee9ca7c884c91ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Creating volume d049fe80-3834-4864-a23b-22645e76e4f3 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:02 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8e7496-9428-49df-b154-52dc2cf1750d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f8d7a8b-d148-478d-8000-0c83aeba3007', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:02 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3 1073741824 Jul 08 11:02:02 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41517fb6-ee6a-4310-8dbc-a5733dadf1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:02 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume volume-2f8d7a8b-d148-478d-8000-0c83aeba3007 (2f8d7a8b-d148-478d-8000-0c83aeba3007): created successfully Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41517fb6-ee6a-4310-8dbc-a5733dadf1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (0bc69aba-4460-4090-ad67-f0dcd30a999d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:02 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-942e12b4-75c3-4d49-b299-a5eebb140feb tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created volume successfully. Jul 08 11:02:02 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD" returned: 1 in 0.839s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Temporary image 293026ad-0ab6-47a3-a90a-71e7796031a9 is fetched for user caba49678bb54e7faa1d10f49fdae198. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a643eebf-226e-4c1e-850f-940c198b5bc3]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:02 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD Jul 08 11:02:02 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:03 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD" returned: 0 in 0.808s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:03 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD Jul 08 11:02:03 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:03 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3 1073741824" returned: 0 in 0.947s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:03 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3 Jul 08 11:02:03 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:03 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:03 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD Jul 08 11:02:03 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:03 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD" returned: 1 in 0.903s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:03 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Temporary image 65f184cf-8460-49d9-899f-b50d4643ace9 is fetched for user 0faa8c1e4d8b4510be041caa8669ca7d. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[afffe528-de3d-48e8-98af-a3bad8acb9bd]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:04 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD Jul 08 11:02:04 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (3fe856d2-468b-4208-b3a9-cd0650937eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a38dca-9650-469f-bad8-56cace8113e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a38dca-9650-469f-bad8-56cace8113e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-551718405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684dcf85-e901-42d2-a101-3fbcd63ff459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:04Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05293a6-ed4b-4849-a374-2bc92bf4b309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05293a6-ed4b-4849-a374-2bc92bf4b309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3be9ad-c800-49e6-b85f-3e6bca1ab558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3be9ad-c800-49e6-b85f-3e6bca1ab558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '684dcf85-e901-42d2-a101-3fbcd63ff459', 'volume_name': 'volume-684dcf85-e901-42d2-a101-3fbcd63ff459', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055eb260-0bc9-43fd-94db-539a27dccccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055eb260-0bc9-43fd-94db-539a27dccccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c935910b-dc7d-4c04-8482-c94902c6db7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:04 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume 684dcf85-e901-42d2-a101-3fbcd63ff459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-684dcf85-e901-42d2-a101-3fbcd63ff459', 'volume_size': 1} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:04 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3" returned: 0 in 0.872s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.136s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2092386779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30e2d8b-acd3-4f53-aed1-4c854c11af49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831568649b7e4f57ada6e5e8c40ed8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:58Z,use_quota=True,user_id='ad0424c9c05e476aaee9ca7c884c91ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Creating volume f30e2d8b-acd3-4f53-aed1-4c854c11af49 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:04 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c2081c-6cf6-4c35-b756-aa3f49f97f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d049fe80-3834-4864-a23b-22645e76e4f3', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:04 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49 1073741824 Jul 08 11:02:04 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353e9f05-e76f-402e-ab37-44f7f5627c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:04 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Volume volume-d049fe80-3834-4864-a23b-22645e76e4f3 (d049fe80-3834-4864-a23b-22645e76e4f3): created successfully Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353e9f05-e76f-402e-ab37-44f7f5627c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Flow 'volume_create_manager' (9976d4d4-a828-44fb-9167-a2a986f3b051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:04 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5d270f60-06b6-44e4-8d26-3467c3c1577b tempest-CreateVolumesFromImageTest-1466185834 None] Created volume successfully. Jul 08 11:02:04 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD" returned: 1 in 1.115s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (fcf1779a-d901-47bc-bf4a-b56c7deb048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660081aa-79d8-4e86-bab1-319fc688f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660081aa-79d8-4e86-bab1-319fc688f923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1341254087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb57804-4c74-4af5-a482-cf5991956ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:05Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49964dbb-bc6f-48e7-b653-b38a0356a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49964dbb-bc6f-48e7-b653-b38a0356a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10dddfd-e741-4724-8297-72e42ecf3ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10dddfd-e741-4724-8297-72e42ecf3ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb57804-4c74-4af5-a482-cf5991956ede', 'volume_name': 'volume-4cb57804-4c74-4af5-a482-cf5991956ede', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03133c3-f3a2-475d-9a4f-ff296105c196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03133c3-f3a2-475d-9a4f-ff296105c196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a69467d-3459-4ad9-9df5-512824083129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume 4cb57804-4c74-4af5-a482-cf5991956ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb57804-4c74-4af5-a482-cf5991956ede', 'volume_size': 1} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:05 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD" returned: 0 in 1.094s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:05 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD Jul 08 11:02:05 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (463885e6-54b0-4a36-8be2-8e82523c2fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ef2d85-f2e3-4930-adac-54406a1cda73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ef2d85-f2e3-4930-adac-54406a1cda73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447323913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841a2761-3c66-4143-9626-7b4335b27ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:05Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95687fce-1439-4ddc-a4ee-6b3f6696cedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95687fce-1439-4ddc-a4ee-6b3f6696cedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932052f6-c13e-4ad8-9149-7629b01a7ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932052f6-c13e-4ad8-9149-7629b01a7ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '841a2761-3c66-4143-9626-7b4335b27ffb', 'volume_name': 'volume-841a2761-3c66-4143-9626-7b4335b27ffb', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90976f7-7508-42d6-9ad4-8312328bf1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90976f7-7508-42d6-9ad4-8312328bf1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472c7dc8-1e33-4fa3-b14a-3945cfec7f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume 841a2761-3c66-4143-9626-7b4335b27ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-841a2761-3c66-4143-9626-7b4335b27ffb', 'volume_size': 1} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (d28b03b6-a978-4e43-818e-2719cbdd6a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9760ab6a-73f8-4db5-8f98-12bf2c6daeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9760ab6a-73f8-4db5-8f98-12bf2c6daeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656583165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69640a98-728c-48d6-8b82-f1e73fbd3df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:06Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903721e0-0600-43be-b033-5a92e7797c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903721e0-0600-43be-b033-5a92e7797c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c4f37f-1371-40db-bcdb-04dda3967173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c4f37f-1371-40db-bcdb-04dda3967173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69640a98-728c-48d6-8b82-f1e73fbd3df7', 'volume_name': 'volume-69640a98-728c-48d6-8b82-f1e73fbd3df7', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95d0fda-a27f-4250-a68a-12f495e2076a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95d0fda-a27f-4250-a68a-12f495e2076a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3a2ecc-1c3a-42ea-85d6-33f509b841b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:05 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume 69640a98-728c-48d6-8b82-f1e73fbd3df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69640a98-728c-48d6-8b82-f1e73fbd3df7', 'volume_size': 1} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:05 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49 1073741824" returned: 0 in 1.376s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:05 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49 Jul 08 11:02:05 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:06 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD" returned: 1 in 0.897s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (943ea3e8-2d16-46f4-8de6-6ee8c97dde63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e938d335-093c-4e1a-a37d-2d55c0ce602b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e938d335-093c-4e1a-a37d-2d55c0ce602b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673482863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a023b199-a097-417f-8dc2-3973cca550f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:06Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c568cdeb-658c-4fcc-9564-c7c8793333ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c568cdeb-658c-4fcc-9564-c7c8793333ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129b322a-c446-41d5-8ec3-c049c2ec99b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129b322a-c446-41d5-8ec3-c049c2ec99b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a023b199-a097-417f-8dc2-3973cca550f5', 'volume_name': 'volume-a023b199-a097-417f-8dc2-3973cca550f5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098f1ff2-6b85-4a09-a704-84a74d1f6802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098f1ff2-6b85-4a09-a704-84a74d1f6802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504e2d26-15f2-4f03-852f-8c1259911f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:06 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume a023b199-a097-417f-8dc2-3973cca550f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a023b199-a097-417f-8dc2-3973cca550f5', 'volume_size': 1} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:06 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49" returned: 0 in 0.713s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.786s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1190692648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbb5fdc-c058-4d62-be7f-18d3c7e911e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831568649b7e4f57ada6e5e8c40ed8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:01:59Z,use_quota=True,user_id='ad0424c9c05e476aaee9ca7c884c91ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Creating volume 6fbb5fdc-c058-4d62-be7f-18d3c7e911e8 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:06 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae98628-27e8-4558-9484-4cbcfce44a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:06 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8 1073741824 Jul 08 11:02:06 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271a0953-25cc-4c81-956c-7797d8fc0967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:06 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Volume volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49 (f30e2d8b-acd3-4f53-aed1-4c854c11af49): created successfully Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271a0953-25cc-4c81-956c-7797d8fc0967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Flow 'volume_create_manager' (be4d071d-4c3d-4d80-93b7-d1e7e3eda467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:06 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-78f4f0e4-5a39-4541-a337-75f73e875fb8 tempest-CreateVolumesFromImageTest-1466185834 None] Created volume successfully. Jul 08 11:02:07 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8 1073741824" returned: 0 in 0.890s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:07 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8 Jul 08 11:02:07 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:08 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8" returned: 0 in 0.659s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.805s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-551718405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684dcf85-e901-42d2-a101-3fbcd63ff459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:04Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Creating volume 684dcf85-e901-42d2-a101-3fbcd63ff459 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:08 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61cfd59-372d-446f-b601-88c5a7bfe53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:08 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459 1073741824 Jul 08 11:02:08 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f906dde5-bbd7-4801-a716-6a5fd9818c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:08 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Volume volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8 (6fbb5fdc-c058-4d62-be7f-18d3c7e911e8): created successfully Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f906dde5-bbd7-4801-a716-6a5fd9818c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Flow 'volume_create_manager' (c61e14f5-26d7-4b5b-8f17-7d55045f2db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:08 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-52592aee-4710-474d-9db4-f70d7a5a0a73 tempest-CreateVolumesFromImageTest-1466185834 None] Created volume successfully. Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "cinder-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "cinder-quobyte-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-quobyte-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d2b0ae-0a1f-4849-b31a-d886bf7a2b1b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:08 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8 Jul 08 11:02:08 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:09 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459 1073741824" returned: 0 in 0.861s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:09 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459 Jul 08 11:02:09 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:09 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8" returned: 0 in 0.797s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:09 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8 Jul 08 11:02:09 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:09 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459" returned: 0 in 0.664s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.036s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc11652-ddaa-4894-9b50-74903644683a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b587fe4788e5443abc3b10f9b64ee5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:00Z,use_quota=True,user_id='caba49678bb54e7faa1d10f49fdae198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Creating volume 5bc11652-ddaa-4894-9b50-74903644683a {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:09 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:09 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a 1073741824 Jul 08 11:02:09 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c935910b-dc7d-4c04-8482-c94902c6db7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-684dcf85-e901-42d2-a101-3fbcd63ff459', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf87987-7f8b-4406-a904-be70bfadc352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:09 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume volume-684dcf85-e901-42d2-a101-3fbcd63ff459 (684dcf85-e901-42d2-a101-3fbcd63ff459): created successfully Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf87987-7f8b-4406-a904-be70bfadc352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (3fe856d2-468b-4208-b3a9-cd0650937eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-66ee0245-9105-4115-9ba7-f323f4c3a63b tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created volume successfully. Jul 08 11:02:10 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8" returned: 0 in 0.672s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-quobyte-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8" released by "delete_volume" :: held 1.512s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Created reservations ['bafd43bc-0525-4de7-8262-05e96cb85ba9', '27903371-ddf9-42bc-9ec7-caeb2f648883', '97f4cfaf-f7e8-49f5-970e-1e5f85b8ba7b', 'de1595cf-8ae8-435a-95bd-c13e1ba3d12d'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:10 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:10 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:10 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a 1073741824" returned: 0 in 0.822s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:10 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a Jul 08 11:02:10 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "cinder-f30e2d8b-acd3-4f53-aed1-4c854c11af49-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-f30e2d8b-acd3-4f53-aed1-4c854c11af49-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "cinder-quobyte-f30e2d8b-acd3-4f53-aed1-4c854c11af49" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-quobyte-f30e2d8b-acd3-4f53-aed1-4c854c11af49" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[259f8534-7c1f-4a52-a022-d8d50031d24f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:11 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.730s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:11 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Deleted volume successfully. Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-666408b1-84fd-42bc-8ac9-70f48326ca65 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-6fbb5fdc-c058-4d62-be7f-18d3c7e911e8-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:11 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49 Jul 08 11:02:11 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:11 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a" returned: 0 in 0.696s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.362s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1341254087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb57804-4c74-4af5-a482-cf5991956ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:05Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Creating volume 4cb57804-4c74-4af5-a482-cf5991956ede {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:11 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:11 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede 1073741824 Jul 08 11:02:11 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Attempting download of 293026ad-0ab6-47a3-a90a-71e7796031a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/293026ad-0ab6-47a3-a90a-71e7796031a9', 'metadata': {}}])) to volume 5bc11652-ddaa-4894-9b50-74903644683a. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf14d0b-58e1-4d8d-9533-f351648fda99]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_293026ad-0ab6-47a3-a90a-71e7796031a9_fzco9dpw {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:11 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_293026ad-0ab6-47a3-a90a-71e7796031a9_fzco9dpw Jul 08 11:02:11 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:11 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49" returned: 0 in 0.852s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:11 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49 Jul 08 11:02:11 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:12 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede 1073741824" returned: 0 in 0.874s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:12 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_293026ad-0ab6-47a3-a90a-71e7796031a9_fzco9dpw" returned: 0 in 0.857s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:12 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_293026ad-0ab6-47a3-a90a-71e7796031a9_fzco9dpw {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:12 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:12 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f30e2d8b-acd3-4f53-aed1-4c854c11af49" returned: 0 in 0.693s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-quobyte-f30e2d8b-acd3-4f53-aed1-4c854c11af49" released by "delete_volume" :: held 1.595s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:12 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_293026ad-0ab6-47a3-a90a-71e7796031a9_fzco9dpw Jul 08 11:02:12 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Created reservations ['2e68749d-d82c-4e42-9467-b0997121182e', '9354ffbc-bba8-47ce-b7c3-0c8721e7edeb', 'c74d2c2b-1c5a-4e3e-96f8-1fe8ae4c270d', 'e96bf83a-8a28-4a09-9a4b-e93af7ed4aa0'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:12 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:12 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:13 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede" returned: 0 in 0.707s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.595s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447323913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841a2761-3c66-4143-9626-7b4335b27ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:05Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Creating volume 841a2761-3c66-4143-9626-7b4335b27ffb {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:13 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "cinder-d049fe80-3834-4864-a23b-22645e76e4f3-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:13 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb 1073741824 Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a69467d-3459-4ad9-9df5-512824083129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb57804-4c74-4af5-a482-cf5991956ede', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:13 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52826460-056f-4f6f-998a-9b8e44599e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-d049fe80-3834-4864-a23b-22645e76e4f3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:13 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume volume-4cb57804-4c74-4af5-a482-cf5991956ede (4cb57804-4c74-4af5-a482-cf5991956ede): created successfully Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52826460-056f-4f6f-998a-9b8e44599e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (fcf1779a-d901-47bc-bf4a-b56c7deb048b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:13 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_293026ad-0ab6-47a3-a90a-71e7796031a9_fzco9dpw" returned: 1 in 0.823s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_293026ad-0ab6-47a3-a90a-71e7796031a9_fzco9dpw' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88a792f-c2ba-4be5-a41e-7bedb2b3bef8]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "cinder-quobyte-d049fe80-3834-4864-a23b-22645e76e4f3" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:13 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1ee1e068-60e4-4f67-8f46-0825169f12c7 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created volume successfully. Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-quobyte-d049fe80-3834-4864-a23b-22645e76e4f3" acquired by "delete_volume" :: waited 0.044s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f55b09-3cd8-4f68-87fa-91e72ba3fd55]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:13 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD Jul 08 11:02:13 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:13 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3 Jul 08 11:02:13 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:13 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.856s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:13 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Deleted volume successfully. Jul 08 11:02:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-034b15e6-f67d-4ca4-a2dc-bd5175346ff5 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-f30e2d8b-acd3-4f53-aed1-4c854c11af49-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:14 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb 1073741824" returned: 0 in 0.987s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:14 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb Jul 08 11:02:14 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:14 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD" returned: 0 in 0.983s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:14 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3" returned: 0 in 0.963s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:14 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3 Jul 08 11:02:14 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:14 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD Jul 08 11:02:14 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:14 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb" returned: 0 in 0.693s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656583165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69640a98-728c-48d6-8b82-f1e73fbd3df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:06Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Creating volume 69640a98-728c-48d6-8b82-f1e73fbd3df7 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:14 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:14 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7 1073741824 Jul 08 11:02:14 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472c7dc8-1e33-4fa3-b14a-3945cfec7f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841a2761-3c66-4143-9626-7b4335b27ffb', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1b35cc-bb4b-4ac4-9ad3-840bbe3e1361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:14 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume volume-841a2761-3c66-4143-9626-7b4335b27ffb (841a2761-3c66-4143-9626-7b4335b27ffb): created successfully Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1b35cc-bb4b-4ac4-9ad3-840bbe3e1361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (463885e6-54b0-4a36-8be2-8e82523c2fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:14 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f9ed7c76-6cbf-4ddb-8832-2e4449b99368 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created volume successfully. Jul 08 11:02:14 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD" returned: 1 in 0.793s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] 293026ad-0ab6-47a3-a90a-71e7796031a9 was raw, converting to raw {{(pid=86913) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:02:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:15 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a Jul 08 11:02:15 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:15 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d049fe80-3834-4864-a23b-22645e76e4f3" returned: 0 in 0.751s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-quobyte-d049fe80-3834-4864-a23b-22645e76e4f3" released by "delete_volume" :: held 1.773s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Created reservations ['91629de3-da8f-4928-8641-b46efb9be203', '186f0de4-da24-470b-b5ae-58e1fdc48e47', '5d3771ce-da32-45fc-8d69-a4c6c468df37', 'f2c99ceb-b5d0-4a03-b9c2-1a6550ac2a55'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:15 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:15 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "cinder-d043c166-a635-4aad-8a26-07722af3d3a5-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-d043c166-a635-4aad-8a26-07722af3d3a5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "cinder-quobyte-d043c166-a635-4aad-8a26-07722af3d3a5" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-quobyte-d043c166-a635-4aad-8a26-07722af3d3a5" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1be341a-54c4-4dba-bae6-7621adeb0333]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:15 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5 Jul 08 11:02:15 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:15 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7 1073741824" returned: 0 in 0.960s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:15 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a" returned: 0 in 0.898s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_293026ad-0ab6-47a3-a90a-71e7796031a9_zs9h8snqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:02:15 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 11:02:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:15 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7 Jul 08 11:02:15 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:15 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a 1G Jul 08 11:02:15 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:16 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.949s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:16 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Deleted volume successfully. Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d7001e15-732e-4418-a693-4b3493cc1944 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-d049fe80-3834-4864-a23b-22645e76e4f3-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:16 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5" returned: 0 in 0.914s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:16 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5 Jul 08 11:02:16 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:16 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7" returned: 0 in 0.726s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.520s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a292b412-bd25-419e-9e6e-737c065d4c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec564858ab5043ef80de60b32740d9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:02Z,use_quota=True,user_id='0faa8c1e4d8b4510be041caa8669ca7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d58ba1f-60e1-4b81-8121-cb576589d34b),volume_type_id=9d58ba1f-60e1-4b81-8121-cb576589d34b)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Creating volume a292b412-bd25-419e-9e6e-737c065d4c8c {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:16 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3a2ecc-1c3a-42ea-85d6-33f509b841b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69640a98-728c-48d6-8b82-f1e73fbd3df7', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:16 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c 1073741824 Jul 08 11:02:16 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4537372e-5a4a-4ef1-b6fb-bd8b8ec778dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:16 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume volume-69640a98-728c-48d6-8b82-f1e73fbd3df7 (69640a98-728c-48d6-8b82-f1e73fbd3df7): created successfully Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4537372e-5a4a-4ef1-b6fb-bd8b8ec778dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (d28b03b6-a978-4e43-818e-2719cbdd6a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:16 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9f87bec8-1615-4983-b045-43b2e4538500 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created volume successfully. Jul 08 11:02:16 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a 1G" returned: 0 in 0.837s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[48036066-fe3b-4544-a23f-ee7a9adfcf12]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:16 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a Jul 08 11:02:16 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:17 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-d043c166-a635-4aad-8a26-07722af3d3a5" returned: 0 in 0.767s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-quobyte-d043c166-a635-4aad-8a26-07722af3d3a5" released by "delete_volume" :: held 1.751s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Created reservations ['10b4eb73-4609-4b41-a462-c2b3fc3ca2c2', '693c0128-2acc-4efb-b32c-775d82425502', 'f8407fb2-0e1e-4886-91cb-8fcb93e902d8', '57ccecf7-be18-4cfb-95c3-c9eb7ccb520d'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:17 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:17 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:17 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c 1073741824" returned: 0 in 0.974s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:17 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a" returned: 0 in 0.843s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:17 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c Jul 08 11:02:17 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "cinder-ba93fe42-b113-4b75-a4cb-46adc0b2aa63-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-ba93fe42-b113-4b75-a4cb-46adc0b2aa63-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:17 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a Jul 08 11:02:17 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "cinder-quobyte-ba93fe42-b113-4b75-a4cb-46adc0b2aa63" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-quobyte-ba93fe42-b113-4b75-a4cb-46adc0b2aa63" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5005d156-46c1-468a-898b-f0aca6ea65da]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:18 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63 Jul 08 11:02:18 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:18 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.783s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Deleted volume successfully. Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a9526e0f-65ae-42f1-91df-20eac1b4fd71 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-d043c166-a635-4aad-8a26-07722af3d3a5-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:18 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c" returned: 0 in 0.828s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.245s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673482863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a023b199-a097-417f-8dc2-3973cca550f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af59a13104794ab8b85717e69b71c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:06Z,use_quota=True,user_id='f8dfc0bbfed34592833b61efe8db1ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Creating volume a023b199-a097-417f-8dc2-3973cca550f5 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:18 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:18 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5 1073741824 Jul 08 11:02:18 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Attempting download of 65f184cf-8460-49d9-899f-b50d4643ace9 ((None, [{'url': 'file:///opt/stack/data/glance/images/65f184cf-8460-49d9-899f-b50d4643ace9', 'metadata': {}}])) to volume a292b412-bd25-419e-9e6e-737c065d4c8c. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[181f67cd-c399-4034-a62f-c6f0dfd0742f]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65f184cf-8460-49d9-899f-b50d4643ace9_iqwonxdx {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:18 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a" returned: 1 in 1.075s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Downloaded image 293026ad-0ab6-47a3-a90a-71e7796031a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/293026ad-0ab6-47a3-a90a-71e7796031a9', 'metadata': {}}])) to volume 5bc11652-ddaa-4894-9b50-74903644683a successfully. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Temporary image 293026ad-0ab6-47a3-a90a-71e7796031a9 for user caba49678bb54e7faa1d10f49fdae198 is deleted. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Marking volume 5bc11652-ddaa-4894-9b50-74903644683a as bootable. {{(pid=86913) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Copying metadata from image 293026ad-0ab6-47a3-a90a-71e7796031a9 to 5bc11652-ddaa-4894-9b50-74903644683a. {{(pid=86913) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Creating volume glance metadata for volume 5bc11652-ddaa-4894-9b50-74903644683a backed by image 293026ad-0ab6-47a3-a90a-71e7796031a9 with: {'image_id': '293026ad-0ab6-47a3-a90a-71e7796031a9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3e5395a3b32923be5c5bf7fa437f1c8f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86913) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:02:18 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65f184cf-8460-49d9-899f-b50d4643ace9_iqwonxdx Jul 08 11:02:18 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5b86a0-6cbf-4418-9afd-199099fcba42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc11652-ddaa-4894-9b50-74903644683a', 'volume_size': 1, 'image_id': '293026ad-0ab6-47a3-a90a-71e7796031a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/293026ad-0ab6-47a3-a90a-71e7796031a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3e5395a3b32923be5c5bf7fa437f1c8f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b587fe4788e5443abc3b10f9b64ee5b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60fdbac5a620d79db90c0d8a9423e3b643bec2e776c3bf2212c545dd44ea2f89f6edeaa71a04d9b4b8ea51d76082e7bdbcbdf3e6259348a2671bd15b57ababdc', 'id': '293026ad-0ab6-47a3-a90a-71e7796031a9', 'created_at': datetime.datetime(2026, 7, 8, 9, 1, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 1, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/293026ad-0ab6-47a3-a90a-71e7796031a9/file', 'properties': {}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e115fd7-1297-44ce-9f2a-84689d48c6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:18 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Volume volume-5bc11652-ddaa-4894-9b50-74903644683a (5bc11652-ddaa-4894-9b50-74903644683a): created successfully Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e115fd7-1297-44ce-9f2a-84689d48c6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:18 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Flow 'volume_create_manager' (bd4ea207-69a3-4942-89f0-7f6fc7abd0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63" returned: 0 in 0.986s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1d91f3db-f29d-4ab6-b3d8-cd1eb7ccb52f tempest-VolumeImageDependencyTests-1452877289 None] Created volume successfully. Jul 08 11:02:18 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63 Jul 08 11:02:18 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:19 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5 1073741824" returned: 0 in 1.013s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:19 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65f184cf-8460-49d9-899f-b50d4643ace9_iqwonxdx" returned: 0 in 0.918s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65f184cf-8460-49d9-899f-b50d4643ace9_iqwonxdx {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:19 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5 Jul 08 11:02:19 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:19 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65f184cf-8460-49d9-899f-b50d4643ace9_iqwonxdx Jul 08 11:02:19 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:19 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba93fe42-b113-4b75-a4cb-46adc0b2aa63" returned: 0 in 0.755s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-quobyte-ba93fe42-b113-4b75-a4cb-46adc0b2aa63" released by "delete_volume" :: held 1.796s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Created reservations ['6046aaac-5f15-4762-b58c-a0868ab1e8fc', '5539c0ed-7945-4e4d-a717-51eb113eb061', 'af77e65f-e949-4560-8428-9d99ea918cd7', '5fda98f5-7929-42a2-b396-942e84d5691b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:19 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:19 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Acquiring lock "cinder-5bc11652-ddaa-4894-9b50-74903644683a-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Lock "cinder-5bc11652-ddaa-4894-9b50-74903644683a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Acquiring lock "cinder-quobyte-5bc11652-ddaa-4894-9b50-74903644683a" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Lock "cinder-quobyte-5bc11652-ddaa-4894-9b50-74903644683a" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c6bd42-1533-45e6-8c1b-bdec732b2d97]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:20 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a Jul 08 11:02:20 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:20 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5" returned: 0 in 0.964s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:20 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504e2d26-15f2-4f03-852f-8c1259911f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a023b199-a097-417f-8dc2-3973cca550f5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d713ff-7b3d-4d4e-8139-d02cba6ce280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65f184cf-8460-49d9-899f-b50d4643ace9_iqwonxdx" returned: 1 in 1.036s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65f184cf-8460-49d9-899f-b50d4643ace9_iqwonxdx' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec96e95-787b-4ab9-bbd9-2d79ba7e9957]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:20 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Volume volume-a023b199-a097-417f-8dc2-3973cca550f5 (a023b199-a097-417f-8dc2-3973cca550f5): created successfully Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d713ff-7b3d-4d4e-8139-d02cba6ce280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Flow 'volume_create_manager' (943ea3e8-2d16-46f4-8de6-6ee8c97dde63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ff01c3af-e90a-497d-a49e-f71b2e5754f3 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created volume successfully. Jul 08 11:02:20 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD Jul 08 11:02:20 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:20 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.928s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Deleted volume successfully. Jul 08 11:02:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2d398b6e-1816-485d-bb5e-dc53bad4e925 tempest-CreateVolumesFromImageTest-1466185834 None] Lock "cinder-ba93fe42-b113-4b75-a4cb-46adc0b2aa63-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:21 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a" returned: 0 in 0.961s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:21 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a Jul 08 11:02:21 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-a023b199-a097-417f-8dc2-3973cca550f5-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:21 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD" returned: 0 in 0.954s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-a023b199-a097-417f-8dc2-3973cca550f5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-quobyte-a023b199-a097-417f-8dc2-3973cca550f5" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-a023b199-a097-417f-8dc2-3973cca550f5" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:21 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76eb965-da04-47d5-914c-fd611710d18d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:21 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD Jul 08 11:02:21 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:21 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5 Jul 08 11:02:21 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:22 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a" returned: 1 in 1.104s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:22 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a Jul 08 11:02:22 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:22 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD" returned: 1 in 1.036s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:22 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] 65f184cf-8460-49d9-899f-b50d4643ace9 was raw, converting to raw {{(pid=86913) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:02:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:22 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c Jul 08 11:02:22 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:22 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5" returned: 0 in 1.083s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:22 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5 Jul 08 11:02:22 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:23 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-5bc11652-ddaa-4894-9b50-74903644683a" returned: 0 in 0.845s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Lock "cinder-quobyte-5bc11652-ddaa-4894-9b50-74903644683a" released by "delete_volume" :: held 3.033s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Created reservations ['0d0284c2-cd0d-49e7-bbd4-ccc5443ce478', '646bc32f-c972-4cc5-ba5b-baaf0cea63d0', '9d4c7c20-8fc9-4886-bcee-345faf0c1dc1', '02ada563-caa0-4814-81c0-87988b058206'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:23 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:23 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:23 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a023b199-a097-417f-8dc2-3973cca550f5" returned: 0 in 0.841s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-a023b199-a097-417f-8dc2-3973cca550f5" released by "delete_volume" :: held 2.003s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created reservations ['6354dc04-2539-4442-9196-041ba8947957', 'bd9a088b-41da-4323-8bea-eb3809272e44', '3c657f9c-2ce7-46c0-ad19-41abf6dd330f', '9a4ad513-5a34-4e8a-a01b-3ce104ef2285'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:23 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c" returned: 0 in 1.288s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65f184cf-8460-49d9-899f-b50d4643ace9_gcczzc92devstack@QuobyteHD, size 0.00 MB, duration 1.29 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:02:23 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:23 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c 1G Jul 08 11:02:23 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:23 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:23 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-69640a98-728c-48d6-8b82-f1e73fbd3df7-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-69640a98-728c-48d6-8b82-f1e73fbd3df7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-quobyte-69640a98-728c-48d6-8b82-f1e73fbd3df7" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-69640a98-728c-48d6-8b82-f1e73fbd3df7" acquired by "delete_volume" :: waited 0.035s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a36304-3278-4a1a-9fb7-7d09dc355fdd]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:24 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.954s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:24 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:24 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Deleted volume successfully. Jul 08 11:02:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f6ee380d-0292-41fb-b22f-3bab572a8699 tempest-VolumeImageDependencyTests-1452877289 None] Lock "cinder-5bc11652-ddaa-4894-9b50-74903644683a-delete_volume" released by "delete_volume" :: held 4.370s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:24 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7 Jul 08 11:02:24 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:24 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c 1G" returned: 0 in 0.985s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba62dded-f4b4-41ad-811f-52a4afba3cd9]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:24 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.156s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:25 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:25 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Deleted volume successfully. Jul 08 11:02:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-18edcfb9-4d97-42b0-ac01-066fc2695c3f tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-a023b199-a097-417f-8dc2-3973cca550f5-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:25 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c Jul 08 11:02:25 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:25 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7" returned: 0 in 1.228s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:25 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7 Jul 08 11:02:25 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:25 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c" returned: 0 in 0.997s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:26 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c Jul 08 11:02:26 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:26 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-69640a98-728c-48d6-8b82-f1e73fbd3df7" returned: 0 in 0.737s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-69640a98-728c-48d6-8b82-f1e73fbd3df7" released by "delete_volume" :: held 2.049s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created reservations ['d00371b7-dbb6-4927-8432-cdb99820ee7b', '3280104e-9ae0-408d-9687-73b1a5c42a6f', '1e0aa2bc-b265-4962-b449-833c741849e2', 'bdd2630b-6c7e-488f-9854-786a115c9878'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:26 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:26 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:26 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c" returned: 1 in 0.900s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Downloaded image 65f184cf-8460-49d9-899f-b50d4643ace9 ((None, [{'url': 'file:///opt/stack/data/glance/images/65f184cf-8460-49d9-899f-b50d4643ace9', 'metadata': {}}])) to volume a292b412-bd25-419e-9e6e-737c065d4c8c successfully. {{(pid=86913) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Temporary image 65f184cf-8460-49d9-899f-b50d4643ace9 for user 0faa8c1e4d8b4510be041caa8669ca7d is deleted. {{(pid=86913) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.volume.volume_utils [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Marking volume a292b412-bd25-419e-9e6e-737c065d4c8c as bootable. {{(pid=86913) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Copying metadata from image 65f184cf-8460-49d9-899f-b50d4643ace9 to a292b412-bd25-419e-9e6e-737c065d4c8c. {{(pid=86913) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Creating volume glance metadata for volume a292b412-bd25-419e-9e6e-737c065d4c8c backed by image 65f184cf-8460-49d9-899f-b50d4643ace9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '65f184cf-8460-49d9-899f-b50d4643ace9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '839503007092e7f2fd293a1098b283d6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86913) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ea9e13-db48-4305-831e-b3a6ff77065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a292b412-bd25-419e-9e6e-737c065d4c8c', 'volume_size': 1, 'image_id': '65f184cf-8460-49d9-899f-b50d4643ace9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65f184cf-8460-49d9-899f-b50d4643ace9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '839503007092e7f2fd293a1098b283d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec564858ab5043ef80de60b32740d9e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a73080cb46087e7cfc53ba7119458aa923d259b87cfa2a95eb55722c2edcb30742161eeef29526e35ea087c8202b685e90f126242b12881e751d269e1822210', 'id': '65f184cf-8460-49d9-899f-b50d4643ace9', 'created_at': datetime.datetime(2026, 7, 8, 9, 1, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65f184cf-8460-49d9-899f-b50d4643ace9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f0b4ef-e908-4f22-938d-e4dca36fdb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:26 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Volume volume-a292b412-bd25-419e-9e6e-737c065d4c8c (a292b412-bd25-419e-9e6e-737c065d4c8c): created successfully Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f0b4ef-e908-4f22-938d-e4dca36fdb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Flow 'volume_create_manager' (6013cf61-f97b-4600-a808-1a3e90c79fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f3f1e9fe-428f-4f1c-9237-6502e3676cac tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Created volume successfully. Jul 08 11:02:27 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.726s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Deleted volume successfully. Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-51065554-adda-4478-b154-9f78b4458eed tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-69640a98-728c-48d6-8b82-f1e73fbd3df7-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-841a2761-3c66-4143-9626-7b4335b27ffb-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-841a2761-3c66-4143-9626-7b4335b27ffb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-quobyte-841a2761-3c66-4143-9626-7b4335b27ffb" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-841a2761-3c66-4143-9626-7b4335b27ffb" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e82c65-1181-4bd5-a913-4375dc5ba633]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:27 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb Jul 08 11:02:27 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Acquiring lock "cinder-a292b412-bd25-419e-9e6e-737c065d4c8c-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Lock "cinder-a292b412-bd25-419e-9e6e-737c065d4c8c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Acquiring lock "cinder-quobyte-a292b412-bd25-419e-9e6e-737c065d4c8c" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Lock "cinder-quobyte-a292b412-bd25-419e-9e6e-737c065d4c8c" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b8417d-303a-4143-9d6d-1a7c25a85382]: (4, 'raw') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:28 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c Jul 08 11:02:28 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:28 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb" returned: 0 in 0.926s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:28 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb Jul 08 11:02:28 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:29 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c" returned: 0 in 1.035s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:29 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c Jul 08 11:02:29 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b540a7a6-569c-425f-992b-17b1ebadebc6 tempest-ProjectAdminTests-208495601 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7446327209473, 'free_capacity_gb': 1775.7446327209473, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86913) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 11:02:29 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-841a2761-3c66-4143-9626-7b4335b27ffb" returned: 0 in 0.876s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-841a2761-3c66-4143-9626-7b4335b27ffb" released by "delete_volume" :: held 1.858s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created reservations ['91f60e72-b5fc-463d-88cf-7107e1dc056e', 'cae0c1d1-4df6-497f-8f64-f17d1522f862', '01161022-51c2-40ee-803c-7a8b871dec75', '2d864902-75b4-4849-a80c-092db4c27087'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:29 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:29 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-4cb57804-4c74-4af5-a482-cf5991956ede-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-4cb57804-4c74-4af5-a482-cf5991956ede-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-quobyte-4cb57804-4c74-4af5-a482-cf5991956ede" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-4cb57804-4c74-4af5-a482-cf5991956ede" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[182840e1-7fbc-414f-81c2-32029515b305]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:30 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c" returned: 1 in 0.986s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c' failed. Not Retrying. {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:02:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:30 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede Jul 08 11:02:30 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:30 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c Jul 08 11:02:30 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:30 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.841s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:30 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:30 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Deleted volume successfully. Jul 08 11:02:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b08d3e34-49bd-4dd1-8afd-ad61fb4a2d02 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-841a2761-3c66-4143-9626-7b4335b27ffb-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:30 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a292b412-bd25-419e-9e6e-737c065d4c8c" returned: 0 in 0.924s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:30 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede" returned: 0 in 1.089s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Lock "cinder-quobyte-a292b412-bd25-419e-9e6e-737c065d4c8c" released by "delete_volume" :: held 3.064s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:30 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede Jul 08 11:02:30 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:31 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Created reservations ['888b039e-c97c-458c-9475-84be7d0a5838', 'cbe5103f-4c8e-4f37-8858-7b0c5adf9714', 'eeb3068a-8f1e-4ab6-ac23-d89180198cc2', 'c8e392a6-b0ab-4fb2-9da4-df223da3cd3c'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:31 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:31 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:31 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4cb57804-4c74-4af5-a482-cf5991956ede" returned: 0 in 1.024s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-4cb57804-4c74-4af5-a482-cf5991956ede" released by "delete_volume" :: held 2.200s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:32 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created reservations ['d45ae4db-ae98-438e-b309-9ba8fc6240f6', '023cdf1f-b1cf-4338-83ad-60b397cc14b2', '5b31a1ae-64e8-471f-b6da-a17a834b3c7c', '45dd9be2-5c36-408a-919e-19c34c270919'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:32 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:32 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:32 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.135s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:32 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:32 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Deleted volume successfully. Jul 08 11:02:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-798d9299-4bb5-4a7e-92fe-3b9f922a1c73 tempest-VolumeAndVolumeTypeFromImageTest-2015974806 None] Lock "cinder-a292b412-bd25-419e-9e6e-737c065d4c8c-delete_volume" released by "delete_volume" :: held 4.529s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-684dcf85-e901-42d2-a101-3fbcd63ff459-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-684dcf85-e901-42d2-a101-3fbcd63ff459-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-quobyte-684dcf85-e901-42d2-a101-3fbcd63ff459" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-684dcf85-e901-42d2-a101-3fbcd63ff459" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:33 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[d565d5fc-8fb5-459c-a507-ed235118dd2f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:33 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.109s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:33 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:33 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Deleted volume successfully. Jul 08 11:02:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ae629913-f4e3-4995-ae0b-98b9f93904f4 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-4cb57804-4c74-4af5-a482-cf5991956ede-delete_volume" released by "delete_volume" :: held 3.675s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:33 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459 Jul 08 11:02:33 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:34 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459" returned: 0 in 1.112s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:34 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459 Jul 08 11:02:34 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:35 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-684dcf85-e901-42d2-a101-3fbcd63ff459" returned: 0 in 0.762s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-684dcf85-e901-42d2-a101-3fbcd63ff459" released by "delete_volume" :: held 1.953s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created reservations ['a449b007-1e24-4337-afeb-6ac2485c8b27', '13c91d97-641d-4c75-ac06-a04b719ee80d', 'd806ceff-bdc8-46a8-97ce-5ed0f6773116', 'f21a14b8-3007-442a-9753-1f840a50419c'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:35 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:35 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-2f8d7a8b-d148-478d-8000-0c83aeba3007-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-2f8d7a8b-d148-478d-8000-0c83aeba3007-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "cinder-quobyte-2f8d7a8b-d148-478d-8000-0c83aeba3007" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-2f8d7a8b-d148-478d-8000-0c83aeba3007" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[532906d9-74b4-42d0-af37-695156d787b3]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:35 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007 Jul 08 11:02:35 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:36 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.032s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:36 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:36 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Deleted volume successfully. Jul 08 11:02:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-f4be530a-5897-4f46-9a3d-c8e9a0593423 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-684dcf85-e901-42d2-a101-3fbcd63ff459-delete_volume" released by "delete_volume" :: held 3.387s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:36 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007" returned: 0 in 0.936s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:36 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007 Jul 08 11:02:36 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:37 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-2f8d7a8b-d148-478d-8000-0c83aeba3007" returned: 0 in 0.706s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-quobyte-2f8d7a8b-d148-478d-8000-0c83aeba3007" released by "delete_volume" :: held 1.713s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:37 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Created reservations ['667be5c1-6196-4a06-998b-00059bff63f7', 'e48de15d-65f6-4c44-b514-1e7e90d1635f', 'a1bbcd92-0d8c-491f-be98-ebcf0f2ec1fd', '7ff2cfcc-fdef-496b-b31f-35b9dd7a9210'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:37 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:37 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (60bb052a-02d1-4653-8df3-fa4cee683aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429942cf-02fa-4ee1-af27-d3a67822f192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429942cf-02fa-4ee1-af27-d3a67822f192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-610831704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec7ec1b-942a-46b2-907e-c86bbcb857f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:38Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0032819-5d8d-4330-8dc5-fbda6d0552d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0032819-5d8d-4330-8dc5-fbda6d0552d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bca879d-a6ae-4a17-9886-156dfd86fb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bca879d-a6ae-4a17-9886-156dfd86fb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec7ec1b-942a-46b2-907e-c86bbcb857f6', 'volume_name': 'volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b16e1a1-f3c1-4395-a287-8406d75cbe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b16e1a1-f3c1-4395-a287-8406d75cbe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a13c2f5-b768-4831-82c7-9d42421af9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:38 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume 0ec7ec1b-942a-46b2-907e-c86bbcb857f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6', 'volume_size': 1} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-610831704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec7ec1b-942a-46b2-907e-c86bbcb857f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:38Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Creating volume 0ec7ec1b-942a-46b2-907e-c86bbcb857f6 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:38 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:38 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 1073741824 Jul 08 11:02:38 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:38 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.067s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:38 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Deleted volume successfully. Jul 08 11:02:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-671a9048-0ec2-4c5b-a0cd-09362c0109e5 tempest-CreateVolumesFromSourceVolumeTest-1813437923 None] Lock "cinder-2f8d7a8b-d148-478d-8000-0c83aeba3007-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:39 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 1073741824" returned: 0 in 1.172s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:39 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 Jul 08 11:02:39 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:40 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6" returned: 0 in 0.958s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a13c2f5-b768-4831-82c7-9d42421af9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68cd59d-617b-4b85-bb7f-84c27a2c0214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:40 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 (0ec7ec1b-942a-46b2-907e-c86bbcb857f6): created successfully Jul 08 11:02:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68cd59d-617b-4b85-bb7f-84c27a2c0214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (60bb052a-02d1-4653-8df3-fa4cee683aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-14b03bae-dd38-45ad-989c-c75e65b0912e tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created volume successfully. Jul 08 11:02:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Creating offline snapshot b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 of volume 0ec7ec1b-942a-46b2-907e-c86bbcb857f6 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:02:41 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[36111409-5c68-4010-9042-1153f2ff1492]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:41 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 Jul 08 11:02:41 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:42 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6" returned: 0 in 0.924s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:42 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 1G Jul 08 11:02:42 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:43 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 1G" returned: 0 in 1.300s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:43 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 Jul 08 11:02:43 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Flow 'volume_create_manager' (94b73298-a593-4302-85ce-6ca98acd4206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53906fb8-49da-4a34-9e04-7bb0b2b3d5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53906fb8-49da-4a34-9e04-7bb0b2b3d5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2089221233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97733e57-1b82-42a3-8d8b-489983834362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc213a2a6814864aac01c016d5c14d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:44Z,use_quota=True,user_id='148251092b1b4ff6b03aa664ff97cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c82e4b-9002-4df3-ba6b-08b517e64e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c82e4b-9002-4df3-ba6b-08b517e64e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21265d4d-dfcb-46ec-a0b6-7877931dd106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21265d4d-dfcb-46ec-a0b6-7877931dd106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97733e57-1b82-42a3-8d8b-489983834362', 'volume_name': 'volume-97733e57-1b82-42a3-8d8b-489983834362', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed0f953-d3d2-4b8e-927c-1bba7814b90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed0f953-d3d2-4b8e-927c-1bba7814b90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7cf2f52-dd59-42c2-a0e8-447632712c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:44 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Volume 97733e57-1b82-42a3-8d8b-489983834362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97733e57-1b82-42a3-8d8b-489983834362', 'volume_size': 1} Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:44 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44" returned: 0 in 0.986s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:44 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 is being set with open permissions: ugo+rw Jul 08 11:02:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:44 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 Jul 08 11:02:44 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:45 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44" returned: 0 in 0.821s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:45 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.info Jul 08 11:02:45 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Flow 'volume_create_manager' (2ff89f16-67ce-47f3-bd77-367e524bbe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb0bc36-389e-4a72-9344-ade728ca78d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb0bc36-389e-4a72-9344-ade728ca78d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136997046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0899e103-82f4-4ff1-abd4-63fc8d2387c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a87811fe17460ea78168aacf24bb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:46Z,use_quota=True,user_id='0ff9206fe72e485788f4be3ca19d82d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df715a73-e3e3-491d-9b82-245c8b4bd454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df715a73-e3e3-491d-9b82-245c8b4bd454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed35429e-f4f4-4658-85a5-b36a85894d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed35429e-f4f4-4658-85a5-b36a85894d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0899e103-82f4-4ff1-abd4-63fc8d2387c1', 'volume_name': 'volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20d14f2-3b85-4a02-bbb7-c70c30eafde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20d14f2-3b85-4a02-bbb7-c70c30eafde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec25501-8c08-4f7f-940a-1e157d1777c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:46 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Volume 0899e103-82f4-4ff1-abd4-63fc8d2387c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1', 'volume_size': 1} Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:46 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.info" returned: 0 in 0.908s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:46 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.info is being set with open permissions: ugo+rw Jul 08 11:02:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:46 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.info Jul 08 11:02:46 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:47 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.info" returned: 0 in 0.696s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.769s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.806s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2089221233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97733e57-1b82-42a3-8d8b-489983834362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc213a2a6814864aac01c016d5c14d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:44Z,use_quota=True,user_id='148251092b1b4ff6b03aa664ff97cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Creating volume 97733e57-1b82-42a3-8d8b-489983834362 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:47 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:47 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 1073741824 Jul 08 11:02:47 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3054ebdb-2a9d-4750-898b-89391b756287 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Create snapshot completed successfully Jul 08 11:02:48 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 1073741824" returned: 0 in 0.972s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:48 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 Jul 08 11:02:48 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (900ad9b3-12aa-4864-b58b-5abf5e51ad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71b0f67-571a-40cd-8134-bfa8094d597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71b0f67-571a-40cd-8134-bfa8094d597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1002783865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d0b2f0-e025-4e5f-897d-09bbead6362a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:48Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8f457a-f741-4a3b-a73a-fcaba7e2ce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8f457a-f741-4a3b-a73a-fcaba7e2ce5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bca01de-34cd-447d-8d6d-9b7c5a703581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bca01de-34cd-447d-8d6d-9b7c5a703581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d0b2f0-e025-4e5f-897d-09bbead6362a', 'volume_name': 'volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac09e74-5c20-4efa-a2ba-2f6d71f0dd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac09e74-5c20-4efa-a2ba-2f6d71f0dd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318723f9-f70a-4ef6-8fca-ce70ae108911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:48 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume f4d0b2f0-e025-4e5f-897d-09bbead6362a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a', 'volume_size': 1} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:48 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (da83d7e0-7e34-46fa-800e-90638b206fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5f0ea0-3e93-4cae-9191-4a0b95b293ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5f0ea0-3e93-4cae-9191-4a0b95b293ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1842241737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a7c352-a5b9-4803-9bb3-ee448139d24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:49Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cc22ed-ca99-4260-8c4d-b0dd15d0595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cc22ed-ca99-4260-8c4d-b0dd15d0595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7429b4f-056c-4611-a258-ca37dfaf24cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7429b4f-056c-4611-a258-ca37dfaf24cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a7c352-a5b9-4803-9bb3-ee448139d24b', 'volume_name': 'volume-42a7c352-a5b9-4803-9bb3-ee448139d24b', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0ca46d-97b8-4fa2-880a-73581d4f4aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0ca46d-97b8-4fa2-880a-73581d4f4aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c93a89b-f1da-42fb-8222-ba92ae3ec881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:49 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume 42a7c352-a5b9-4803-9bb3-ee448139d24b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a7c352-a5b9-4803-9bb3-ee448139d24b', 'volume_size': 1} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:49 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362" returned: 0 in 0.825s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.784s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136997046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0899e103-82f4-4ff1-abd4-63fc8d2387c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a87811fe17460ea78168aacf24bb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:46Z,use_quota=True,user_id='0ff9206fe72e485788f4be3ca19d82d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Creating volume 0899e103-82f4-4ff1-abd4-63fc8d2387c1 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:49 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7cf2f52-dd59-42c2-a0e8-447632712c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97733e57-1b82-42a3-8d8b-489983834362', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a290e0-cb5a-43d1-a77e-a0ba87699966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:49 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Volume volume-97733e57-1b82-42a3-8d8b-489983834362 (97733e57-1b82-42a3-8d8b-489983834362): created successfully Jul 08 11:02:49 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1 1073741824 Jul 08 11:02:49 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a290e0-cb5a-43d1-a77e-a0ba87699966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Flow 'volume_create_manager' (94b73298-a593-4302-85ce-6ca98acd4206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:49 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9302d26e-aaec-4bb7-90ec-46cc4bc66866 tempest-VolumeDependencyTests-88338501 None] Created volume successfully. Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (faabac4b-3bd9-4c9a-81a1-f810c4dceb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae741341-3734-4606-a246-ec5c939bf32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae741341-3734-4606-a246-ec5c939bf32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022426858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba085d7e-6f21-4b06-8be7-5f8c8522b1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:49Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e7e103-694b-4681-ac89-2b9026fb05bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e7e103-694b-4681-ac89-2b9026fb05bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec20463-0cec-4c4a-9063-67f6e75703db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec20463-0cec-4c4a-9063-67f6e75703db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba085d7e-6f21-4b06-8be7-5f8c8522b1fa', 'volume_name': 'volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef1532d-3d3e-4131-b28d-d6dd661eda64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef1532d-3d3e-4131-b28d-d6dd661eda64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a56e12-f443-4a5f-83eb-d276f44e50e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:49 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume ba085d7e-6f21-4b06-8be7-5f8c8522b1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa', 'volume_size': 1} Jul 08 11:02:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (407ab0f2-a777-4ddb-b4a2-7f50f65bc423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1633fb1a-bce0-4b5d-b294-2d553aac4932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1633fb1a-bce0-4b5d-b294-2d553aac4932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122707431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370811a0-c2bf-4d2e-9dec-fad14600d553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:50Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77108525-da13-403f-946f-05e8c80aa4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77108525-da13-403f-946f-05e8c80aa4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b5f35b-d59b-4245-8016-e79ca501e54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b5f35b-d59b-4245-8016-e79ca501e54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '370811a0-c2bf-4d2e-9dec-fad14600d553', 'volume_name': 'volume-370811a0-c2bf-4d2e-9dec-fad14600d553', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e00b52-6058-4ff2-9fd1-7b3c515c11a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e00b52-6058-4ff2-9fd1-7b3c515c11a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b47b56a-9df2-4915-a147-df6db8cc60e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:50 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume 370811a0-c2bf-4d2e-9dec-fad14600d553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-370811a0-c2bf-4d2e-9dec-fad14600d553', 'volume_size': 1} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (4275197e-aa34-42b0-b74e-736039aae9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108b163e-6502-44c0-84f2-86bcce685318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:50 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1 1073741824" returned: 0 in 1.383s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108b163e-6502-44c0-84f2-86bcce685318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820537253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f522301-2090-4f60-915a-f14139cafc74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:51Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4441009a-0fb5-457b-9c89-2b21b6d5bf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4441009a-0fb5-457b-9c89-2b21b6d5bf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1afc353-4a7c-4aeb-8e2e-46ee3f48361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1afc353-4a7c-4aeb-8e2e-46ee3f48361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f522301-2090-4f60-915a-f14139cafc74', 'volume_name': 'volume-0f522301-2090-4f60-915a-f14139cafc74', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3403e7a4-c6c5-4868-ab05-f5e21b094a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3403e7a4-c6c5-4868-ab05-f5e21b094a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fedb671-c889-47c1-b5ad-d835d13bf595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:50 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume 0f522301-2090-4f60-915a-f14139cafc74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f522301-2090-4f60-915a-f14139cafc74', 'volume_size': 1} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:50 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1 Jul 08 11:02:50 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:51 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1" returned: 0 in 0.718s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.913s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1002783865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d0b2f0-e025-4e5f-897d-09bbead6362a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:48Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Creating volume f4d0b2f0-e025-4e5f-897d-09bbead6362a {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:51 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:51 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a 1073741824 Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec25501-8c08-4f7f-940a-1e157d1777c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:51 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4c9ff9-f499-490e-8c15-3a36523f11f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:51 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Volume volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1 (0899e103-82f4-4ff1-abd4-63fc8d2387c1): created successfully Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4c9ff9-f499-490e-8c15-3a36523f11f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Flow 'volume_create_manager' (2ff89f16-67ce-47f3-bd77-367e524bbe79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:51 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-41540bb8-1fed-4bc7-881b-0a7e772a3366 tempest-ProjectReaderTests-549861085 None] Created volume successfully. Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Acquiring lock "cinder-0899e103-82f4-4ff1-abd4-63fc8d2387c1-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Lock "cinder-0899e103-82f4-4ff1-abd4-63fc8d2387c1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Acquiring lock "cinder-quobyte-0899e103-82f4-4ff1-abd4-63fc8d2387c1" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:02:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Lock "cinder-quobyte-0899e103-82f4-4ff1-abd4-63fc8d2387c1" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:02:52 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27340bf-f0d0-4b86-8b49-78eb4e72fba7]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:52 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1 Jul 08 11:02:52 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:52 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a 1073741824" returned: 0 in 0.933s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:52 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a Jul 08 11:02:52 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:52 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1" returned: 0 in 0.924s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:53 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1 Jul 08 11:02:53 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:53 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a" returned: 0 in 0.718s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.196s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1842241737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a7c352-a5b9-4803-9bb3-ee448139d24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:49Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Creating volume 42a7c352-a5b9-4803-9bb3-ee448139d24b {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:53 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=166,cinder:SELECT=112,cinder:DELETE=11,cinder:INSERT=39 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:02:53 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b 1073741824 Jul 08 11:02:53 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318723f9-f70a-4ef6-8fca-ce70ae108911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e1b18f-f807-4503-ac22-a255e2384135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:53 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a (f4d0b2f0-e025-4e5f-897d-09bbead6362a): created successfully Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e1b18f-f807-4503-ac22-a255e2384135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (900ad9b3-12aa-4864-b58b-5abf5e51ad09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:53 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-57f0e3e0-4705-43f2-9df8-69e68b81174f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created volume successfully. Jul 08 11:02:53 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0899e103-82f4-4ff1-abd4-63fc8d2387c1" returned: 0 in 0.903s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Lock "cinder-quobyte-0899e103-82f4-4ff1-abd4-63fc8d2387c1" released by "delete_volume" :: held 1.882s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=129,cinder:UPDATE=160,cinder:INSERT=50,cinder:DELETE=19 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:53 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:53 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Created reservations ['2a261280-0b02-4e94-915d-1c6c5884e46b', '84640ad0-d4b2-4ac8-988b-cdad65d71a35', '9ae2a3b7-4a2d-4219-950c-11ef780ec56b', 'a2ed2d56-e89a-4caa-af1c-50202e5c2bf9'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:54 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:02:54 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:54 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b 1073741824" returned: 0 in 1.192s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:54 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b Jul 08 11:02:54 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:54 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.997s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:02:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Flow 'volume_create_manager' (15077a8f-7278-49eb-a60b-748086e8f4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3c0f4c-bf38-40fa-8e54-e90932e8208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3c0f4c-bf38-40fa-8e54-e90932e8208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-110557287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db036314-8bee-4a1b-9c1d-8b0405e7b2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a87811fe17460ea78168aacf24bb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:55Z,use_quota=True,user_id='0ff9206fe72e485788f4be3ca19d82d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bd640d-2258-49a2-accb-73dc7e9e842b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bd640d-2258-49a2-accb-73dc7e9e842b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c78064-dc3b-4d6f-abcc-4ec3010fdc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:55 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c78064-dc3b-4d6f-abcc-4ec3010fdc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db036314-8bee-4a1b-9c1d-8b0405e7b2d6', 'volume_name': 'volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab8a99c-a806-43ab-9499-f811ca121426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab8a99c-a806-43ab-9499-f811ca121426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326c64a4-0318-45c0-bf13-49c618b185c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:55 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Volume db036314-8bee-4a1b-9c1d-8b0405e7b2d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6', 'volume_size': 1} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.064s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:02:55 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Deleted volume successfully. Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b018817d-5bbb-4437-8e32-4a12fec549b9 tempest-ProjectReaderTests-549861085 None] Lock "cinder-0899e103-82f4-4ff1-abd4-63fc8d2387c1-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:02:55 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b" returned: 0 in 0.940s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.216s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.838s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022426858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba085d7e-6f21-4b06-8be7-5f8c8522b1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:49Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Creating volume ba085d7e-6f21-4b06-8be7-5f8c8522b1fa {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:55 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c93a89b-f1da-42fb-8222-ba92ae3ec881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a7c352-a5b9-4803-9bb3-ee448139d24b', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:55 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa 1073741824 Jul 08 11:02:55 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ce96cd-25a5-42f7-9dd9-65eddc4a6cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:55 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume volume-42a7c352-a5b9-4803-9bb3-ee448139d24b (42a7c352-a5b9-4803-9bb3-ee448139d24b): created successfully Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ce96cd-25a5-42f7-9dd9-65eddc4a6cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:55 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (da83d7e0-7e34-46fa-800e-90638b206fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:55 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-38ed87c5-1fad-4f4e-ba96-58631fa2a6f0 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created volume successfully. Jul 08 11:02:56 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa 1073741824" returned: 0 in 0.943s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:56 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa Jul 08 11:02:56 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:57 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa" returned: 0 in 0.775s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.104s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122707431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370811a0-c2bf-4d2e-9dec-fad14600d553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:50Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Creating volume 370811a0-c2bf-4d2e-9dec-fad14600d553 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:02:57 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:57 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553 1073741824 Jul 08 11:02:57 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a56e12-f443-4a5f-83eb-d276f44e50e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b9c807-ec2e-4f26-b810-b0d1f391c6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:57 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa (ba085d7e-6f21-4b06-8be7-5f8c8522b1fa): created successfully Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b9c807-ec2e-4f26-b810-b0d1f391c6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:57 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (faabac4b-3bd9-4c9a-81a1-f810c4dceb05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:57 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-dae05cf7-bb0c-4ef1-952d-daba66543578 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created volume successfully. Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553 1073741824" returned: 0 in 0.946s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Flow 'volume_create_manager' (c95f1a50-44ff-4f9e-ba19-06221993941e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5c4067-e390-4789-8fa4-9fb2885daa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:58 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5c4067-e390-4789-8fa4-9fb2885daa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1739848861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc79275-8f04-4cd8-a113-bd24f705eba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1b24addbaa49b5a1e690602fe4ef18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:58Z,use_quota=True,user_id='05b317e54d6d4ad0bb67078e83e4e5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48edee1d-5ce7-481f-87b3-f595cd6ec774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48edee1d-5ce7-481f-87b3-f595cd6ec774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09069428-a428-4865-957b-f5da3b009a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09069428-a428-4865-957b-f5da3b009a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc79275-8f04-4cd8-a113-bd24f705eba2', 'volume_name': 'volume-9fc79275-8f04-4cd8-a113-bd24f705eba2', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea04652-d2f9-4269-b41c-a60d513d9049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea04652-d2f9-4269-b41c-a60d513d9049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb51001-905e-457f-b0c1-404ece8db2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:58 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Volume 9fc79275-8f04-4cd8-a113-bd24f705eba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc79275-8f04-4cd8-a113-bd24f705eba2', 'volume_size': 1} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:02:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:58 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553 Jul 08 11:02:58 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:59 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553" returned: 0 in 0.657s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.603s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] Creating offline snapshot ca3a7562-9960-4984-bcd4-1df3c92ad877 of volume 97733e57-1b82-42a3-8d8b-489983834362 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b47b56a-9df2-4915-a147-df6db8cc60e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-370811a0-c2bf-4d2e-9dec-fad14600d553', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1757b5e2-1729-4585-905d-d608abaa854e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[736b807c-b090-4cd8-b351-773517d1d4ac]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:59 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume volume-370811a0-c2bf-4d2e-9dec-fad14600d553 (370811a0-c2bf-4d2e-9dec-fad14600d553): created successfully Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1757b5e2-1729-4585-905d-d608abaa854e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (407ab0f2-a777-4ddb-b4a2-7f50f65bc423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:02:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0932e6ca-62d9-4d61-b420-418e27830732 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created volume successfully. Jul 08 11:02:59 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 Jul 08 11:02:59 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:02:59 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362" returned: 0 in 0.794s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:02:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:02:59 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 1G Jul 08 11:02:59 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:00 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 1G" returned: 0 in 0.833s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97733e57-1b82-42a3-8d8b-489983834362 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:00 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97733e57-1b82-42a3-8d8b-489983834362 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 Jul 08 11:03:00 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:01 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97733e57-1b82-42a3-8d8b-489983834362 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877" returned: 0 in 0.742s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:01 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 is being set with open permissions: ugo+rw Jul 08 11:03:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:01 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 Jul 08 11:03:01 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:02 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877" returned: 0 in 0.648s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:02 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.info Jul 08 11:03:02 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:02 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.info" returned: 0 in 0.732s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:02 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.info is being set with open permissions: ugo+rw Jul 08 11:03:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:02 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.info Jul 08 11:03:02 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:03 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.info" returned: 0 in 0.720s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.574s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.774s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-820537253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f522301-2090-4f60-915a-f14139cafc74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647221ae42146769992cd6f080d73b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:51Z,use_quota=True,user_id='3ecc63dfd6244e70ba66724ce7a077cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Creating volume 0f522301-2090-4f60-915a-f14139cafc74 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:03 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:03:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:03 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74 1073741824 Jul 08 11:03:03 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:03 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a4a5918b-00e5-48a3-a30e-7a5fd2e9997f tempest-VolumeDependencyTests-88338501 None] Create snapshot completed successfully Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Flow 'volume_create_manager' (b3c1cc73-f590-4012-bca5-b3de1d1b116e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:04 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a254f084-16b4-48a7-b195-d72d9e2a80f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74 1073741824" returned: 0 in 0.892s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a254f084-16b4-48a7-b195-d72d9e2a80f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1455379499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d7bc2c-34f2-4950-9b85-04a2ecc11ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc213a2a6814864aac01c016d5c14d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ca3a7562-9960-4984-bcd4-1df3c92ad877,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:04Z,use_quota=True,user_id='148251092b1b4ff6b03aa664ff97cf07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bd5f05-31e9-4ab7-be8d-f71d85a4df1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bd5f05-31e9-4ab7-be8d-f71d85a4df1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f688fc3-568f-4ecb-9769-d1d0c5c69251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f688fc3-568f-4ecb-9769-d1d0c5c69251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58d7bc2c-34f2-4950-9b85-04a2ecc11ec8', 'volume_name': 'volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8', 'volume_size': 1, 'snapshot_id': 'ca3a7562-9960-4984-bcd4-1df3c92ad877'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74043e4d-5278-40f4-98b1-dc08aa10e64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74043e4d-5278-40f4-98b1-dc08aa10e64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3575d91a-2fe9-45d9-ac32-56084aab33e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:04 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Volume 58d7bc2c-34f2-4950-9b85-04a2ecc11ec8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8', 'volume_size': 1, 'snapshot_id': 'ca3a7562-9960-4984-bcd4-1df3c92ad877'} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:04 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74 Jul 08 11:03:04 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:05 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74" returned: 0 in 0.680s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.034s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-110557287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db036314-8bee-4a1b-9c1d-8b0405e7b2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a87811fe17460ea78168aacf24bb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:55Z,use_quota=True,user_id='0ff9206fe72e485788f4be3ca19d82d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Creating volume db036314-8bee-4a1b-9c1d-8b0405e7b2d6 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:05 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fedb671-c889-47c1-b5ad-d835d13bf595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f522301-2090-4f60-915a-f14139cafc74', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:05 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6 1073741824 Jul 08 11:03:05 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1657fedc-26cd-497f-9b4c-68ae74e6e9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:05 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Volume volume-0f522301-2090-4f60-915a-f14139cafc74 (0f522301-2090-4f60-915a-f14139cafc74): created successfully Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1657fedc-26cd-497f-9b4c-68ae74e6e9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Flow 'volume_create_manager' (4275197e-aa34-42b0-b74e-736039aae9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b582503e-7dd0-49d0-a9ff-b516d2fd1f73 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created volume successfully. Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-0f522301-2090-4f60-915a-f14139cafc74-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-0f522301-2090-4f60-915a-f14139cafc74-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-quobyte-0f522301-2090-4f60-915a-f14139cafc74" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-0f522301-2090-4f60-915a-f14139cafc74" acquired by "delete_volume" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6187cf-2aff-4f0a-aeee-03d04162c19a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:06 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74 Jul 08 11:03:06 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:06 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6 1073741824" returned: 0 in 0.884s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:06 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6 Jul 08 11:03:06 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:06 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74" returned: 0 in 0.874s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:06 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74 Jul 08 11:03:06 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:06 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6" returned: 0 in 0.723s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.593s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1739848861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc79275-8f04-4cd8-a113-bd24f705eba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1b24addbaa49b5a1e690602fe4ef18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:02:58Z,use_quota=True,user_id='05b317e54d6d4ad0bb67078e83e4e5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Creating volume 9fc79275-8f04-4cd8-a113-bd24f705eba2 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:06 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:06 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 1073741824 Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326c64a4-0318-45c0-bf13-49c618b185c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:06 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8407acf1-eeb1-48a6-b84d-9df346a6e923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:06 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Volume volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6 (db036314-8bee-4a1b-9c1d-8b0405e7b2d6): created successfully Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8407acf1-eeb1-48a6-b84d-9df346a6e923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:06 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Flow 'volume_create_manager' (15077a8f-7278-49eb-a60b-748086e8f4f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:07 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-6c0130e4-cee5-4aa5-ad9a-6de53ea96818 tempest-ProjectReaderTests-549861085 None] Created volume successfully. Jul 08 11:03:07 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0f522301-2090-4f60-915a-f14139cafc74" returned: 0 in 0.705s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-0f522301-2090-4f60-915a-f14139cafc74" released by "delete_volume" :: held 1.630s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created reservations ['8a093749-9498-4220-8c8c-e0ae3eb4f53d', '488251cd-156b-4284-816c-94d46408f71a', '24d854fd-5257-4cb0-92ad-894877b67492', '069ffba0-53a8-4145-9091-6496d3daa6a4'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:07 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:07 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:07 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 1073741824" returned: 0 in 0.938s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Acquiring lock "cinder-db036314-8bee-4a1b-9c1d-8b0405e7b2d6-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Lock "cinder-db036314-8bee-4a1b-9c1d-8b0405e7b2d6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:07 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 Jul 08 11:03:07 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Acquiring lock "cinder-quobyte-db036314-8bee-4a1b-9c1d-8b0405e7b2d6" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Lock "cinder-quobyte-db036314-8bee-4a1b-9c1d-8b0405e7b2d6" acquired by "delete_volume" :: waited 0.030s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-370811a0-c2bf-4d2e-9dec-fad14600d553-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ba96c6-8ff6-4e4e-bb92-2d8dc107e910]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-370811a0-c2bf-4d2e-9dec-fad14600d553-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-quobyte-370811a0-c2bf-4d2e-9dec-fad14600d553" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-370811a0-c2bf-4d2e-9dec-fad14600d553" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f3dc2f-f3bc-43e2-9b76-a36026ea3067]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:08 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6 Jul 08 11:03:08 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:08 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553 Jul 08 11:03:08 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:08 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.802s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:08 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Deleted volume successfully. Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-4dabf482-9494-4efa-bc7e-f72a5abe4585 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-0f522301-2090-4f60-915a-f14139cafc74-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:08 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2" returned: 0 in 0.856s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.239s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "cinder-quobyte-ca3a7562-9960-4984-bcd4-1df3c92ad877-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" by "_create_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb51001-905e-457f-b0c1-404ece8db2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc79275-8f04-4cd8-a113-bd24f705eba2', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13051a5b-d1b9-4b46-a7ee-bcf4e059d0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-ca3a7562-9960-4984-bcd4-1df3c92ad877-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Creating volume 58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 from snapshot ca3a7562-9960-4984-bcd4-1df3c92ad877 {{(pid=86913) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "cinder-quobyte-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:08 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Volume volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 (9fc79275-8f04-4cd8-a113-bd24f705eba2): created successfully Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13051a5b-d1b9-4b46-a7ee-bcf4e059d0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Flow 'volume_create_manager' (c95f1a50-44ff-4f9e-ba19-06221993941e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] snapshot: ca3a7562-9960-4984-bcd4-1df3c92ad877, volume: 58d7bc2c-34f2-4950-9b85-04a2ecc11ec8, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:03:08 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9cd3dbfa-f127-453f-a5e6-f2a40055c4a8 tempest-SnapshotDependencyTests-640489522 None] Created volume successfully. Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc29b2a-8bb2-43c9-99a5-aa78dd5e0662]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:09 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6" returned: 0 in 0.927s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:09 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6 Jul 08 11:03:09 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:09 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 Jul 08 11:03:09 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:09 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553" returned: 0 in 0.936s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:09 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553 Jul 08 11:03:09 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:09 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-db036314-8bee-4a1b-9c1d-8b0405e7b2d6" returned: 0 in 0.721s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Lock "cinder-quobyte-db036314-8bee-4a1b-9c1d-8b0405e7b2d6" released by "delete_volume" :: held 1.715s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Created reservations ['0cf0c358-6ff0-4f5c-ad74-ec6a7387e4c5', 'fdd5e168-29dd-4287-a477-96af8b200b87', '0e839461-2c50-4f42-8014-f6be96aef355', '41df52b3-1ded-4096-b857-36d058e69a4c'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:09 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-370811a0-c2bf-4d2e-9dec-fad14600d553" returned: 0 in 0.686s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-370811a0-c2bf-4d2e-9dec-fad14600d553" released by "delete_volume" :: held 1.672s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:09 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877" returned: 0 in 0.914s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97733e57-1b82-42a3-8d8b-489983834362(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b644cf55-4d6c-4b38-88a4-81ae0692ed75]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:09 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:09 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:09 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created reservations ['d4105fba-f229-4936-93b0-8b8691f17052', 'e6c03faf-0f3e-4c94-bfb7-372fc8caf951', 'c6d368b5-6fc7-4922-b9f5-024e6aec689e', '5a2ea374-6034-4d55-b228-7d5b0edb16f6'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:10 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 Jul 08 11:03:10 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:10 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:10 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-quobyte-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa" acquired by "delete_volume" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[da18c964-b197-4e71-8978-524fe6b9b36b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:10 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa Jul 08 11:03:10 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:10 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.979s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:10 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Deleted volume successfully. Jul 08 11:03:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5a62fcaf-bd07-4831-a075-31265e58a3b0 tempest-ProjectReaderTests-549861085 None] Lock "cinder-db036314-8bee-4a1b-9c1d-8b0405e7b2d6-delete_volume" released by "delete_volume" :: held 3.049s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:11 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362" returned: 0 in 1.328s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:11 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:03:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:11 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.171s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:11 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:11 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Deleted volume successfully. Jul 08 11:03:11 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 Jul 08 11:03:11 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-af5f3cfd-143f-476e-a370-f8c9d6050851 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-370811a0-c2bf-4d2e-9dec-fad14600d553-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:11 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa" returned: 0 in 1.068s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:11 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa Jul 08 11:03:11 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:12 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa" returned: 0 in 1.103s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:12 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa" released by "delete_volume" :: held 2.268s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:13 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created reservations ['b0eb15b1-5f41-40c9-a3d4-69c5e358aabc', '23ccf014-6dc8-4994-b778-941763802fa9', '4e40d9a1-37be-4cc6-b11e-ff1b0de5505a', '86c5e129-067a-45f2-af25-baa247ec9b34'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:13 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:13 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-42a7c352-a5b9-4803-9bb3-ee448139d24b-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-42a7c352-a5b9-4803-9bb3-ee448139d24b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-quobyte-42a7c352-a5b9-4803-9bb3-ee448139d24b" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-42a7c352-a5b9-4803-9bb3-ee448139d24b" acquired by "delete_volume" :: waited 0.038s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:14 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcfb167-3e86-47ce-9219-47b8e3858dc4]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:14 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.703s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:14 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:14 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b Jul 08 11:03:14 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:14 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Deleted volume successfully. Jul 08 11:03:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-42573ea2-3b0f-45db-bc5c-298b561746dd tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-ba085d7e-6f21-4b06-8be7-5f8c8522b1fa-delete_volume" released by "delete_volume" :: held 4.457s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:16 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b" returned: 0 in 1.622s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:16 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b Jul 08 11:03:16 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:17 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" returned: 0 in 6.213s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2869e349-1795-4fa0-a17a-5bcb08ad0fe0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:17 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 Jul 08 11:03:17 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:17 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-42a7c352-a5b9-4803-9bb3-ee448139d24b" returned: 0 in 1.411s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-42a7c352-a5b9-4803-9bb3-ee448139d24b" released by "delete_volume" :: held 3.138s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created reservations ['687eccac-4d7f-4f2b-9a3b-203d1dcb9350', '2b9a20cd-2936-4688-9ce7-a6bbdbda3306', 'a83311de-bc3c-4693-b8cd-b989ae33d739', 'c46ae83c-b180-4caa-961c-61c3370557a2'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:17 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:17 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-f4d0b2f0-e025-4e5f-897d-09bbead6362a-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-f4d0b2f0-e025-4e5f-897d-09bbead6362a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-quobyte-f4d0b2f0-e025-4e5f-897d-09bbead6362a" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-f4d0b2f0-e025-4e5f-897d-09bbead6362a" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20e28ea-87e6-4a6b-b120-33dc5412db5b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Flow 'volume_create_manager' (77f8d92c-eba1-4a7b-8752-532f0dc20264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444354c8-92f0-4ccb-b64d-5c5df66cb72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444354c8-92f0-4ccb-b64d-5c5df66cb72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113477369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4d9180-840f-46dc-984a-a26a6e7d9a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6808bb5634fe4b1b84bac5c3b16951f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:18Z,use_quota=True,user_id='8f68f6b5fe354d85bcb49d16976ea5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a904bb-90c1-49b9-874d-4d6f1f462c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a904bb-90c1-49b9-874d-4d6f1f462c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404d0992-1159-45e1-94fa-1fbc36c1f5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404d0992-1159-45e1-94fa-1fbc36c1f5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4d9180-840f-46dc-984a-a26a6e7d9a53', 'volume_name': 'volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40d362b-e91a-43e9-81a3-f8e0d989b877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40d362b-e91a-43e9-81a3-f8e0d989b877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74bff57-6368-4a44-88e1-70fa747513b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:18 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Volume 1a4d9180-840f-46dc-984a-a26a6e7d9a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53', 'volume_size': 1} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:18 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a Jul 08 11:03:18 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:18 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.720s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:18 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Deleted volume successfully. Jul 08 11:03:18 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8876b6cb-dda5-4aa8-b254-7b3184c27c5f tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-42a7c352-a5b9-4803-9bb3-ee448139d24b-delete_volume" released by "delete_volume" :: held 4.270s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362" returned: 0 in 1.095s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:03:18 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Converted 1024.00 MB image at 164.77 MB/s Jul 08 11:03:18 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 is being set with open permissions: ugo+rw Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:18 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 Jul 08 11:03:18 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:18 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a" returned: 0 in 0.838s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:18 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a Jul 08 11:03:18 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:19 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" returned: 0 in 0.679s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" released by "_copy_volume_from_snapshot" :: held 10.348s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-ca3a7562-9960-4984-bcd4-1df3c92ad877-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" released by "_create_volume_from_snapshot" :: held 10.404s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.450s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.751s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] Creating offline snapshot 43d04b2d-1c4c-4b40-91f6-1810df71fb65 of volume 9fc79275-8f04-4cd8-a113-bd24f705eba2 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3575d91a-2fe9-45d9-ac32-56084aab33e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8', 'volume_size': 1, 'snapshot_id': 'ca3a7562-9960-4984-bcd4-1df3c92ad877'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5db14ba-23c3-485d-bba8-1a9f714e8b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6140b51a-5ef4-4c69-adde-24f4aa5dfe28]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:19 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Volume volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 (58d7bc2c-34f2-4950-9b85-04a2ecc11ec8): created successfully Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5db14ba-23c3-485d-bba8-1a9f714e8b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Flow 'volume_create_manager' (b3c1cc73-f590-4012-bca5-b3de1d1b116e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:19 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8b4b3788-5448-41f3-a56f-ee95e2d8f727 tempest-VolumeDependencyTests-88338501 None] Created volume successfully. Jul 08 11:03:19 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 Jul 08 11:03:19 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:19 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f4d0b2f0-e025-4e5f-897d-09bbead6362a" returned: 0 in 0.704s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-f4d0b2f0-e025-4e5f-897d-09bbead6362a" released by "delete_volume" :: held 1.593s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created reservations ['2aeab48c-7d81-4541-a16f-0c815711a0ad', '0cfe3503-ed2a-419b-bc3a-fd9b0c5d17f5', '9d73457f-dab2-4181-a1ff-d4de8ec7b0a9', '8cc52642-f02b-4f8b-b304-5193c0a782d8'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:19 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:19 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "cinder-ca3a7562-9960-4984-bcd4-1df3c92ad877-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-ca3a7562-9960-4984-bcd4-1df3c92ad877-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "cinder-quobyte-97733e57-1b82-42a3-8d8b-489983834362" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-97733e57-1b82-42a3-8d8b-489983834362" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "cinder-quobyte-ca3a7562-9960-4984-bcd4-1df3c92ad877" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-ca3a7562-9960-4984-bcd4-1df3c92ad877" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Deleting offline snapshot ca3a7562-9960-4984-bcd4-1df3c92ad877 of volume 97733e57-1b82-42a3-8d8b-489983834362 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] snapshot_file for this snap is: volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbfd9d8-40e7-4569-8329-3290932b180e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:20 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 Jul 08 11:03:20 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:20 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2" returned: 0 in 0.888s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-quobyte-0ec7ec1b-942a-46b2-907e-c86bbcb857f6" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-0ec7ec1b-942a-46b2-907e-c86bbcb857f6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-quobyte-b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:20 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 1G Jul 08 11:03:20 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Deleting offline snapshot b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 of volume 0ec7ec1b-942a-46b2-907e-c86bbcb857f6 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] snapshot_file for this snap is: volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[969869d8-f1c4-4abe-8364-2b9da453e6d4]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:20 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 Jul 08 11:03:20 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:20 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.770s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:20 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Deleted volume successfully. Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9dd7b5ec-024e-4842-9578-b185d05c3979 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-f4d0b2f0-e025-4e5f-897d-09bbead6362a-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:20 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877" returned: 0 in 0.991s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97733e57-1b82-42a3-8d8b-489983834362(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[29522e39-c7ca-4ae9-8edb-9356468354c4]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:21 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 Jul 08 11:03:21 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:21 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 1G" returned: 0 in 0.948s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:21 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 Jul 08 11:03:21 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:21 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44" returned: 0 in 0.880s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:21 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:03:21 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5ba71a-56a3-42eb-b7c2-7a1d9fb2a837]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:21 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 Jul 08 11:03:21 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:21 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362" returned: 0 in 0.912s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:21 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65" returned: 0 in 0.768s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:21 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 is being set with open permissions: ugo+rw Jul 08 11:03:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:21 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 Jul 08 11:03:21 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:21 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 Jul 08 11:03:21 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:22 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6" returned: 0 in 0.857s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:22 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 Jul 08 11:03:22 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:22 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65" returned: 0 in 0.730s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:22 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.info Jul 08 11:03:22 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:22 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877" returned: 0 in 0.843s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:22 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877 Jul 08 11:03:22 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:22 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44" returned: 0 in 0.855s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:22 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44 Jul 08 11:03:22 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:23 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.info" returned: 0 in 0.701s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:23 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.info is being set with open permissions: ugo+rw Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:23 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.info Jul 08 11:03:23 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:23 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362.ca3a7562-9960-4984-bcd4-1df3c92ad877" returned: 0 in 0.765s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-ca3a7562-9960-4984-bcd4-1df3c92ad877" released by "_delete_snapshot" :: held 3.642s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-97733e57-1b82-42a3-8d8b-489983834362" released by "delete_snapshot" :: held 3.675s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Created reservations ['a490cd6d-915a-41ea-a591-ca45fad7b7ca', '6c1abc3d-2e1f-4ba1-b9e0-3d260d08590b', 'b7f0f880-2dd5-40cc-9bf4-e8d4d5ce9dd6', 'acd2bde6-87b4-43ca-a1f5-5fbf645af7ec'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:23 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6.b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44" returned: 0 in 0.730s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:23 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Delete snapshot completed successfully. Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44" released by "_delete_snapshot" :: held 3.447s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ebb9bef6-f122-447e-986b-69714775d1c6 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-ca3a7562-9960-4984-bcd4-1df3c92ad877-delete_snapshot" released by "delete_snapshot" :: held 3.854s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-0ec7ec1b-942a-46b2-907e-c86bbcb857f6" released by "delete_snapshot" :: held 3.479s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created reservations ['45f810e2-deef-4c96-bb55-a2826066d4d1', '21bc159a-98b6-4682-963a-ec0bb493a25b', '5c467313-3023-4084-a01a-82f9ec769389', '18491255-c8a1-4ecf-935f-61e6654159e8'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:23 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Delete snapshot completed successfully. Jul 08 11:03:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7adfce13-aa57-46d9-a5fb-08bd3b486908 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-b0ca1b4e-9e9e-41b2-ab78-7d30aad57a44-delete_snapshot" released by "delete_snapshot" :: held 3.617s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:24 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.info" returned: 0 in 0.687s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.836s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.932s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113477369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4d9180-840f-46dc-984a-a26a6e7d9a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6808bb5634fe4b1b84bac5c3b16951f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:18Z,use_quota=True,user_id='8f68f6b5fe354d85bcb49d16976ea5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Creating volume 1a4d9180-840f-46dc-984a-a26a6e7d9a53 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:24 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Acquiring lock "cinder-97733e57-1b82-42a3-8d8b-489983834362-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:24 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53 1073741824 Jul 08 11:03:24 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Lock "cinder-97733e57-1b82-42a3-8d8b-489983834362-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:24 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ed68f061-7b75-496b-ab6b-d35f60a80be4 tempest-SnapshotDependencyTests-640489522 None] Create snapshot completed successfully Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Acquiring lock "cinder-quobyte-97733e57-1b82-42a3-8d8b-489983834362" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-97733e57-1b82-42a3-8d8b-489983834362" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bdeec7-2728-4e52-ba21-2ca806db7403]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-0ec7ec1b-942a-46b2-907e-c86bbcb857f6-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:24 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 Jul 08 11:03:24 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-0ec7ec1b-942a-46b2-907e-c86bbcb857f6-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "cinder-quobyte-0ec7ec1b-942a-46b2-907e-c86bbcb857f6" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-0ec7ec1b-942a-46b2-907e-c86bbcb857f6" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd2082-6da3-4263-9dc3-31b1a08fdf7a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:24 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 Jul 08 11:03:24 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Flow 'volume_create_manager' (4b1f24e9-26f7-4187-b794-b233e803b4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633f149f-4839-4c98-9029-704219fc4703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633f149f-4839-4c98-9029-704219fc4703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05af8631-4cf8-4201-9f4b-89916ee76d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1b24addbaa49b5a1e690602fe4ef18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43d04b2d-1c4c-4b40-91f6-1810df71fb65,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:25Z,use_quota=True,user_id='05b317e54d6d4ad0bb67078e83e4e5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d899ba0-5165-48cf-af4e-ee76f051197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d899ba0-5165-48cf-af4e-ee76f051197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdd03b0-1bcb-4b3e-a2c2-d17d4be94168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdd03b0-1bcb-4b3e-a2c2-d17d4be94168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05af8631-4cf8-4201-9f4b-89916ee76d62', 'volume_name': 'volume-05af8631-4cf8-4201-9f4b-89916ee76d62', 'volume_size': 1, 'snapshot_id': '43d04b2d-1c4c-4b40-91f6-1810df71fb65'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244cc6db-3efc-49ff-9d72-5bf1990c9b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244cc6db-3efc-49ff-9d72-5bf1990c9b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe54644-03a5-4712-a420-ca6fa00d6397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:25 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Volume 05af8631-4cf8-4201-9f4b-89916ee76d62: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05af8631-4cf8-4201-9f4b-89916ee76d62', 'volume_size': 1, 'snapshot_id': '43d04b2d-1c4c-4b40-91f6-1810df71fb65'} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:25 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53 1073741824" returned: 0 in 1.142s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:25 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53 Jul 08 11:03:25 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:25 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362" returned: 0 in 1.058s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:25 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362 Jul 08 11:03:25 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:25 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6" returned: 0 in 0.966s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:25 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6 Jul 08 11:03:25 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:26 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-97733e57-1b82-42a3-8d8b-489983834362" returned: 0 in 0.702s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:26 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53" returned: 0 in 0.764s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-97733e57-1b82-42a3-8d8b-489983834362" released by "delete_volume" :: held 1.854s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.858s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "cinder-quobyte-43d04b2d-1c4c-4b40-91f6-1810df71fb65-05af8631-4cf8-4201-9f4b-89916ee76d62" by "_create_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74bff57-6368-4a44-88e1-70fa747513b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12924a2c-5805-4f05-bf36-5cd06cc13426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-43d04b2d-1c4c-4b40-91f6-1810df71fb65-05af8631-4cf8-4201-9f4b-89916ee76d62" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Creating volume 05af8631-4cf8-4201-9f4b-89916ee76d62 from snapshot 43d04b2d-1c4c-4b40-91f6-1810df71fb65 {{(pid=86913) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "cinder-quobyte-05af8631-4cf8-4201-9f4b-89916ee76d62" by "_copy_volume_from_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:26 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Volume volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53 (1a4d9180-840f-46dc-984a-a26a6e7d9a53): created successfully Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12924a2c-5805-4f05-bf36-5cd06cc13426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Flow 'volume_create_manager' (77f8d92c-eba1-4a7b-8752-532f0dc20264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-05af8631-4cf8-4201-9f4b-89916ee76d62" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] snapshot: 43d04b2d-1c4c-4b40-91f6-1810df71fb65, volume: 05af8631-4cf8-4201-9f4b-89916ee76d62, {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:03:26 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-938423be-251a-46ab-9bc8-79df471e1de6 tempest-ProjectReaderTests-141072374 None] Created volume successfully. Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff033da8-8a31-4665-af07-0f26bbd70a3e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Created reservations ['0744867e-1359-49fe-a737-94b6bb4d4cd7', '8c68ed47-25fd-4223-b0e5-429e8c2e9f6b', '293814e3-f64d-44b9-b47e-067df457145d', '863cb85f-d195-4278-b007-75ecfc156c91'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:26 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-0ec7ec1b-942a-46b2-907e-c86bbcb857f6" returned: 0 in 0.724s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-quobyte-0ec7ec1b-942a-46b2-907e-c86bbcb857f6" released by "delete_volume" :: held 1.784s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:26 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 Jul 08 11:03:26 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Created reservations ['1d919b3e-68be-4092-8ef6-372e3c3eda8a', 'e0abd3b6-1c97-4a1d-9fa2-3cf5f0416469', 'c92aa9b8-82a2-48a4-b85c-09594b1dfb20', 'b81a4eb9-2a29-4a4b-9ac1-9a931e02e601'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:26 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:26 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:26 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:26 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Acquiring lock "cinder-1a4d9180-840f-46dc-984a-a26a6e7d9a53-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:26 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Lock "cinder-1a4d9180-840f-46dc-984a-a26a6e7d9a53-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Acquiring lock "cinder-quobyte-1a4d9180-840f-46dc-984a-a26a6e7d9a53" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Lock "cinder-quobyte-1a4d9180-840f-46dc-984a-a26a6e7d9a53" acquired by "delete_volume" :: waited 0.033s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc27eb07-3124-489e-a28e-6a5b4c0fe064]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:27 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53 Jul 08 11:03:27 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:27 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65" returned: 0 in 1.142s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fc79275-8f04-4cd8-a113-bd24f705eba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Creating direct copy from snapshot {{(pid=86913) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8199e6db-9138-4ea2-8d42-9eebe08d9b7a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "cinder-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:27 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 Jul 08 11:03:27 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "cinder-quobyte-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:27 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.098s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Deleted volume successfully. Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" acquired by "delete_volume" :: waited 0.034s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0915a57d-a7a0-4369-8884-47bd5eb53a0b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-10b22051-3a38-4db0-a21c-7a289f097424 tempest-CreateVolumesFromSnapshotTest-1789532007 None] Lock "cinder-0ec7ec1b-942a-46b2-907e-c86bbcb857f6-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:27 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.350s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Deleted volume successfully. Jul 08 11:03:27 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-e35f49a0-f7b6-482d-9108-4de33411a4ab tempest-VolumeDependencyTests-88338501 None] Lock "cinder-97733e57-1b82-42a3-8d8b-489983834362-delete_volume" released by "delete_volume" :: held 3.737s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:27 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 Jul 08 11:03:27 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:28 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53" returned: 0 in 1.151s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:28 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53 Jul 08 11:03:28 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:28 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2" returned: 0 in 1.246s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:28 devstack cinder-volume[86913]: DEBUG cinder.utils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Path /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62 not found in is_blk_device check {{(pid=86913) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:03:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:28 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62 Jul 08 11:03:28 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:28 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" returned: 0 in 1.154s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:28 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8 Jul 08 11:03:28 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:29 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-1a4d9180-840f-46dc-984a-a26a6e7d9a53" returned: 0 in 0.807s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Lock "cinder-quobyte-1a4d9180-840f-46dc-984a-a26a6e7d9a53" released by "delete_volume" :: held 2.011s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:29 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Created reservations ['124ca023-b700-47b4-bc08-f4213a0b8554', 'ca2f08c8-3daf-4995-9ccd-d0fa15163fe6', '470b2232-91f8-4531-8976-6b23d93f7e57', 'fa3ee8c1-fd22-4c1d-9e69-5d433f55c232'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:29 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:29 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:29 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Flow 'volume_create_manager' (102bd876-0716-42f1-b7e5-19bfaaaf6f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fb596e-3449-49fa-8f54-173dac1f8829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fb596e-3449-49fa-8f54-173dac1f8829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-52172796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0507275-5fd9-4c07-b2a6-aaa74ae77412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6808bb5634fe4b1b84bac5c3b16951f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:30Z,use_quota=True,user_id='8f68f6b5fe354d85bcb49d16976ea5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58720029-6beb-44b9-845d-d1f5ff7738ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58720029-6beb-44b9-845d-d1f5ff7738ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940b893b-d088-4c19-b1c6-49626d7ba40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940b893b-d088-4c19-b1c6-49626d7ba40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0507275-5fd9-4c07-b2a6-aaa74ae77412', 'volume_name': 'volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05abcfa0-b02d-43e5-975c-de9cc22b034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05abcfa0-b02d-43e5-975c-de9cc22b034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f09fe79-e3e8-4fd9-abe5-ec0f19b6598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:30 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Volume a0507275-5fd9-4c07-b2a6-aaa74ae77412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412', 'volume_size': 1} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:30 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" returned: 0 in 1.627s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-quobyte-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8" released by "delete_volume" :: held 2.866s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Created reservations ['f9a409f0-7816-4a38-8c04-f4a073230240', 'd015e4b8-c5f5-43a9-bf6b-f0d3a6c140a5', '72040d46-6455-4b94-a720-ca9d225355be', '86673607-817f-41ca-b8f9-a72dce741037'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:30 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.476s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:30 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Deleted volume successfully. Jul 08 11:03:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d12154fe-8195-43de-81bf-c55d48acd71e tempest-ProjectReaderTests-141072374 None] Lock "cinder-1a4d9180-840f-46dc-984a-a26a6e7d9a53-delete_volume" released by "delete_volume" :: held 3.881s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:31 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:31 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:32 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.612s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:32 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:32 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Deleted volume successfully. Jul 08 11:03:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ace0f780-c1e3-4920-a80d-13d2c4c890a1 tempest-VolumeDependencyTests-88338501 None] Lock "cinder-58d7bc2c-34f2-4950-9b85-04a2ecc11ec8-delete_volume" released by "delete_volume" :: held 5.182s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Flow 'volume_create_manager' (dd0c9cce-ff05-4371-8dec-81f89c2652a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cfec14-abdf-4ba0-b348-464b526ae983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cfec14-abdf-4ba0-b348-464b526ae983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531531987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9942dee-c633-4d40-b197-ca6f86b122f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa76fa3faab44cbbb2388e0d44761d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:35Z,use_quota=True,user_id='5b29973515404a20a618c33ce3b081ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09628633-f2d3-4ce3-a6d8-202bff27d53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09628633-f2d3-4ce3-a6d8-202bff27d53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436f4381-5dcd-49d6-b9e0-75a249f6fd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436f4381-5dcd-49d6-b9e0-75a249f6fd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9942dee-c633-4d40-b197-ca6f86b122f0', 'volume_name': 'volume-e9942dee-c633-4d40-b197-ca6f86b122f0', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186f4246-55a0-479a-b455-7357b093892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186f4246-55a0-479a-b455-7357b093892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fe9c29-796d-42d9-afaf-726c05e1bdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:35 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Volume e9942dee-c633-4d40-b197-ca6f86b122f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9942dee-c633-4d40-b197-ca6f86b122f0', 'volume_size': 1} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:35 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62" returned: 0 in 6.846s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed8295f-3694-4880-9928-6c386e889a76]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:35 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 Jul 08 11:03:35 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:36 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2" returned: 0 in 0.965s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:36 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Image conversion details: src /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62 {{(pid=86913) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:03:36 devstack cinder-volume[86913]: INFO cinder.image.image_utils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Converted 1024.00 MB image at 149.55 MB/s Jul 08 11:03:36 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62 is being set with open permissions: ugo+rw Jul 08 11:03:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:36 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62 Jul 08 11:03:36 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:37 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62" returned: 0 in 0.695s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-05af8631-4cf8-4201-9f4b-89916ee76d62" released by "_copy_volume_from_snapshot" :: held 11.036s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-43d04b2d-1c4c-4b40-91f6-1810df71fb65-05af8631-4cf8-4201-9f4b-89916ee76d62" released by "_create_volume_from_snapshot" :: held 11.093s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.136s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.693s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-52172796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0507275-5fd9-4c07-b2a6-aaa74ae77412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6808bb5634fe4b1b84bac5c3b16951f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:30Z,use_quota=True,user_id='8f68f6b5fe354d85bcb49d16976ea5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Creating volume a0507275-5fd9-4c07-b2a6-aaa74ae77412 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:37 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:37 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412 1073741824 Jul 08 11:03:37 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Flow 'volume_create_manager' (3870ed97-e1b3-4d8c-a294-50171d620e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd51947-9d74-477a-ac53-3a8636cfd575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe54644-03a5-4712-a420-ca6fa00d6397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05af8631-4cf8-4201-9f4b-89916ee76d62', 'volume_size': 1, 'snapshot_id': '43d04b2d-1c4c-4b40-91f6-1810df71fb65'}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687bf375-0444-4168-b877-37874ab67f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd51947-9d74-477a-ac53-3a8636cfd575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96583249-2196-40f8-b827-424f35796f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412b5abca29b4f10b35db8e2b7b82acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:37Z,use_quota=True,user_id='d570f39cce444fc797345fb111d19969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65400d72-d809-4fb2-ba61-b41248e4fa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65400d72-d809-4fb2-ba61-b41248e4fa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5cb2b8-fb9d-4a86-b38c-9a093c3412da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5cb2b8-fb9d-4a86-b38c-9a093c3412da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96583249-2196-40f8-b827-424f35796f99', 'volume_name': 'volume-96583249-2196-40f8-b827-424f35796f99', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916a015e-44dc-48be-8930-2101e05eca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916a015e-44dc-48be-8930-2101e05eca91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911da4d4-4e9f-4ceb-a2e6-66fe4538a8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:37 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Volume 96583249-2196-40f8-b827-424f35796f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96583249-2196-40f8-b827-424f35796f99', 'volume_size': 1} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:37 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Volume volume-05af8631-4cf8-4201-9f4b-89916ee76d62 (05af8631-4cf8-4201-9f4b-89916ee76d62): created successfully Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687bf375-0444-4168-b877-37874ab67f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Flow 'volume_create_manager' (4b1f24e9-26f7-4187-b794-b233e803b4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:37 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-dfeb0dae-410d-48c3-96d3-ae9b6dbc5601 tempest-SnapshotDependencyTests-640489522 None] Created volume successfully. Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "cinder-43d04b2d-1c4c-4b40-91f6-1810df71fb65-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-43d04b2d-1c4c-4b40-91f6-1810df71fb65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "cinder-quobyte-9fc79275-8f04-4cd8-a113-bd24f705eba2" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-9fc79275-8f04-4cd8-a113-bd24f705eba2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "cinder-quobyte-43d04b2d-1c4c-4b40-91f6-1810df71fb65" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-43d04b2d-1c4c-4b40-91f6-1810df71fb65" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Deleting offline snapshot 43d04b2d-1c4c-4b40-91f6-1810df71fb65 of volume 9fc79275-8f04-4cd8-a113-bd24f705eba2 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] snapshot_file for this snap is: volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d011d00-bd38-494f-995e-566a6e6cec75]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:37 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 Jul 08 11:03:37 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412 1073741824" returned: 0 in 0.947s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:38 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:38 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412 Jul 08 11:03:38 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:38 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65" returned: 0 in 0.789s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fc79275-8f04-4cd8-a113-bd24f705eba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7583d63-791e-438f-897f-e1e98982cab1]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:38 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 Jul 08 11:03:38 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:38 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412" returned: 0 in 0.719s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.528s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531531987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9942dee-c633-4d40-b197-ca6f86b122f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa76fa3faab44cbbb2388e0d44761d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:35Z,use_quota=True,user_id='5b29973515404a20a618c33ce3b081ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Creating volume e9942dee-c633-4d40-b197-ca6f86b122f0 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:38 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:38 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 1073741824 Jul 08 11:03:38 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f09fe79-e3e8-4fd9-abe5-ec0f19b6598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458d5a5a-d219-4164-99e0-39630746272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:38 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Volume volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412 (a0507275-5fd9-4c07-b2a6-aaa74ae77412): created successfully Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458d5a5a-d219-4164-99e0-39630746272e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Flow 'volume_create_manager' (102bd876-0716-42f1-b7e5-19bfaaaf6f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ce7478e4-736b-487e-844d-a9209e0e3b1a tempest-ProjectReaderTests-141072374 None] Created volume successfully. Jul 08 11:03:39 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2" returned: 0 in 0.850s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:39 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 Jul 08 11:03:39 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:39 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 1073741824" returned: 0 in 0.860s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:39 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 Jul 08 11:03:39 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Acquiring lock "cinder-a0507275-5fd9-4c07-b2a6-aaa74ae77412-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Lock "cinder-a0507275-5fd9-4c07-b2a6-aaa74ae77412-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Acquiring lock "cinder-quobyte-a0507275-5fd9-4c07-b2a6-aaa74ae77412" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Lock "cinder-quobyte-a0507275-5fd9-4c07-b2a6-aaa74ae77412" acquired by "delete_volume" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b5ede8-19d0-4fa6-a536-e1adbe6715e6]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:40 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412 Jul 08 11:03:40 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:40 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65" returned: 0 in 0.889s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:40 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65 Jul 08 11:03:40 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:40 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0" returned: 0 in 0.783s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.264s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96583249-2196-40f8-b827-424f35796f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412b5abca29b4f10b35db8e2b7b82acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:37Z,use_quota=True,user_id='d570f39cce444fc797345fb111d19969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Creating volume 96583249-2196-40f8-b827-424f35796f99 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:40 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:40 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99 1073741824 Jul 08 11:03:40 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fe9c29-796d-42d9-afaf-726c05e1bdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9942dee-c633-4d40-b197-ca6f86b122f0', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e13ec0-9d7c-4c2f-b623-e23a6a623b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:40 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Volume volume-e9942dee-c633-4d40-b197-ca6f86b122f0 (e9942dee-c633-4d40-b197-ca6f86b122f0): created successfully Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e13ec0-9d7c-4c2f-b623-e23a6a623b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Flow 'volume_create_manager' (dd0c9cce-ff05-4371-8dec-81f89c2652a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:40 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-571a0efa-ecfc-4332-b47d-e9722b8bff24 tempest-ProjectReaderTests-875080478 None] Created volume successfully. Jul 08 11:03:40 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412" returned: 0 in 0.796s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:40 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412 Jul 08 11:03:40 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:41 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2.43d04b2d-1c4c-4b40-91f6-1810df71fb65" returned: 0 in 0.775s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-43d04b2d-1c4c-4b40-91f6-1810df71fb65" released by "_delete_snapshot" :: held 3.420s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-9fc79275-8f04-4cd8-a113-bd24f705eba2" released by "delete_snapshot" :: held 3.447s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Created reservations ['7a829991-cb0e-4352-8f96-57d0c8002037', 'dfa1b6c2-330f-438e-8c5d-db8106e8ac96', 'acdc2fa6-7f24-4cb5-9556-2cacbfe63659', 'd099592c-3fca-4576-b3c4-7e91ae03d689'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:41 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Delete snapshot completed successfully. Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-3b09438b-7b33-452e-84dd-7f00df0e8902 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-43d04b2d-1c4c-4b40-91f6-1810df71fb65-delete_snapshot" released by "delete_snapshot" :: held 3.589s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:41 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99 1073741824" returned: 0 in 1.004s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:41 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:41 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99 Jul 08 11:03:41 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-a0507275-5fd9-4c07-b2a6-aaa74ae77412" returned: 0 in 0.786s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Lock "cinder-quobyte-a0507275-5fd9-4c07-b2a6-aaa74ae77412" released by "delete_volume" :: held 1.625s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Created reservations ['c26f05d3-6ff1-45b4-82f3-11333e8fd9a3', '3039fb4e-9c8f-4d5b-a6f7-da57411e9bc5', '98292e50-7664-44a0-a8f0-07d16bb8e126', 'eb928116-c92c-4efc-9a6f-1b9bbbd5b9f0'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:41 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:41 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "cinder-9fc79275-8f04-4cd8-a113-bd24f705eba2-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-9fc79275-8f04-4cd8-a113-bd24f705eba2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:41 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "cinder-quobyte-9fc79275-8f04-4cd8-a113-bd24f705eba2" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-9fc79275-8f04-4cd8-a113-bd24f705eba2" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e6f81e-e763-4aa9-9d5d-138613473c11]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:42 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 Jul 08 11:03:42 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:42 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99" returned: 0 in 0.735s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.751s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911da4d4-4e9f-4ceb-a2e6-66fe4538a8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96583249-2196-40f8-b827-424f35796f99', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2e2e1e-f740-4fa8-a40a-2a12574c338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] Creating offline snapshot 257134a4-5d42-491a-be3a-c989678fb124 of volume e9942dee-c633-4d40-b197-ca6f86b122f0 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:03:42 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Volume volume-96583249-2196-40f8-b827-424f35796f99 (96583249-2196-40f8-b827-424f35796f99): created successfully Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2e2e1e-f740-4fa8-a40a-2a12574c338b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Flow 'volume_create_manager' (3870ed97-e1b3-4d8c-a294-50171d620e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1671ea3-4046-4a23-92ad-af36f67ffd70]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:42 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2206a78f-2fc5-4cda-90c4-8009b6bc10cb tempest-CinderUnicodeTest-1934744455 None] Created volume successfully. Jul 08 11:03:42 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 Jul 08 11:03:42 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:42 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.888s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:42 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Deleted volume successfully. Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a362ce1f-7910-469c-a9f0-1de5ee1450af tempest-ProjectReaderTests-141072374 None] Lock "cinder-a0507275-5fd9-4c07-b2a6-aaa74ae77412-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Flow 'volume_create_manager' (074315af-1f6a-4327-90e1-044e07eb9837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54fe1147-c7b2-477e-93fe-fc9094667908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54fe1147-c7b2-477e-93fe-fc9094667908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-105138369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c794e50f-e91d-4ee1-8875-b812fed47b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6808bb5634fe4b1b84bac5c3b16951f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:43Z,use_quota=True,user_id='8f68f6b5fe354d85bcb49d16976ea5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb00a05f-8702-449f-8b90-790dab4796f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb00a05f-8702-449f-8b90-790dab4796f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3953f42-5809-4a35-9e6f-bbb2782618fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3953f42-5809-4a35-9e6f-bbb2782618fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c794e50f-e91d-4ee1-8875-b812fed47b21', 'volume_name': 'volume-c794e50f-e91d-4ee1-8875-b812fed47b21', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1489d5-e3e4-4f09-8ca8-717b71c43eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1489d5-e3e4-4f09-8ca8-717b71c43eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29016a06-05df-4de1-b7a6-8ced6abae629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:42 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Volume c794e50f-e91d-4ee1-8875-b812fed47b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c794e50f-e91d-4ee1-8875-b812fed47b21', 'volume_size': 1} Jul 08 11:03:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:43 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2" returned: 0 in 0.978s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:43 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2 Jul 08 11:03:43 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:43 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0" returned: 0 in 0.848s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:43 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 1G Jul 08 11:03:43 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:43 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-9fc79275-8f04-4cd8-a113-bd24f705eba2" returned: 0 in 0.707s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-9fc79275-8f04-4cd8-a113-bd24f705eba2" released by "delete_volume" :: held 1.748s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Created reservations ['1058a206-6bbd-4a5a-b894-06747f56a202', 'fe05a208-6140-479b-90f0-1bfbd1f3f6a5', 'b02977cd-a246-427e-aab1-a00296757478', 'f46d82b8-3f36-4c69-98c1-0021727affd2'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:43 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:43 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "cinder-05af8631-4cf8-4201-9f4b-89916ee76d62-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-05af8631-4cf8-4201-9f4b-89916ee76d62-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "cinder-quobyte-05af8631-4cf8-4201-9f4b-89916ee76d62" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-05af8631-4cf8-4201-9f4b-89916ee76d62" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:44 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[468b7aaf-67e9-4a79-9cb5-b37f39f584b1]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 1G" returned: 0 in 0.974s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9942dee-c633-4d40-b197-ca6f86b122f0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:44 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9942dee-c633-4d40-b197-ca6f86b122f0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 Jul 08 11:03:44 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Flow 'volume_create_manager' (a273bf9b-49e4-4c17-aeec-6e05c3c45cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ff5c79-af8c-4ac3-b5e8-e6776a2928c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ff5c79-af8c-4ac3-b5e8-e6776a2928c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1125135182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7576e2-3b53-4256-be4d-ce0bd76b1621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412b5abca29b4f10b35db8e2b7b82acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:44Z,use_quota=True,user_id='d570f39cce444fc797345fb111d19969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6f0f5a-8a0c-4d5f-90e4-f565e6038fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:44 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62 Jul 08 11:03:44 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6f0f5a-8a0c-4d5f-90e4-f565e6038fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f319e4c-b9d5-41bd-b28d-29cfe90b5724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f319e4c-b9d5-41bd-b28d-29cfe90b5724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb7576e2-3b53-4256-be4d-ce0bd76b1621', 'volume_name': 'volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44fe7ca-ca2f-486b-b184-ef48ffce79ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44fe7ca-ca2f-486b-b184-ef48ffce79ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bee126-c173-462a-8db3-9264803a2969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:44 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Volume eb7576e2-3b53-4256-be4d-ce0bd76b1621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621', 'volume_size': 1} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:44 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.939s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:44 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Deleted volume successfully. Jul 08 11:03:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a2d0792c-225a-4bcb-a346-019349061a40 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-9fc79275-8f04-4cd8-a113-bd24f705eba2-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:45 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9942dee-c633-4d40-b197-ca6f86b122f0 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124" returned: 0 in 0.738s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:45 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 is being set with open permissions: ugo+rw Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:45 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 Jul 08 11:03:45 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:45 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62" returned: 0 in 0.858s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:45 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62 Jul 08 11:03:45 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:45 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124" returned: 0 in 0.734s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:45 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-05af8631-4cf8-4201-9f4b-89916ee76d62" returned: 0 in 0.691s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:45 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.info Jul 08 11:03:45 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-quobyte-05af8631-4cf8-4201-9f4b-89916ee76d62" released by "delete_volume" :: held 1.614s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Created reservations ['7dd6a6cd-0e08-4469-9c4f-7d603a3c9493', '81aab4d9-6def-46ea-b169-f55b9cbecefd', '21ff9aef-0821-4619-9033-d7b64062e11b', '73b32911-2e7c-40d9-98fe-13d3f28d7836'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:46 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:46 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:46 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.info" returned: 0 in 0.721s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:46 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.info is being set with open permissions: ugo+rw Jul 08 11:03:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:46 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.info Jul 08 11:03:46 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:46 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.700s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:46 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Deleted volume successfully. Jul 08 11:03:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-28a45186-7466-4daf-9957-3a48f2370939 tempest-SnapshotDependencyTests-640489522 None] Lock "cinder-05af8631-4cf8-4201-9f4b-89916ee76d62-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:47 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.info" returned: 0 in 0.734s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.923s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.432s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-105138369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c794e50f-e91d-4ee1-8875-b812fed47b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6808bb5634fe4b1b84bac5c3b16951f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:43Z,use_quota=True,user_id='8f68f6b5fe354d85bcb49d16976ea5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Creating volume c794e50f-e91d-4ee1-8875-b812fed47b21 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:47 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:03:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:47 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21 1073741824 Jul 08 11:03:47 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e4a2365a-8dda-46a6-bfa1-7168923f11c3 tempest-ProjectReaderTests-875080478 None] Create snapshot completed successfully Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-257134a4-5d42-491a-be3a-c989678fb124-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Lock "cinder-257134a4-5d42-491a-be3a-c989678fb124-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-e9942dee-c633-4d40-b197-ca6f86b122f0" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-e9942dee-c633-4d40-b197-ca6f86b122f0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-257134a4-5d42-491a-be3a-c989678fb124" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-257134a4-5d42-491a-be3a-c989678fb124" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Deleting offline snapshot 257134a4-5d42-491a-be3a-c989678fb124 of volume e9942dee-c633-4d40-b197-ca6f86b122f0 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] snapshot_file for this snap is: volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7c979a-e7cc-44fb-b1a4-69a990f8f33b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:48 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21 1073741824" returned: 0 in 1.029s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:48 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 Jul 08 11:03:48 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:48 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21 Jul 08 11:03:48 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:49 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21" returned: 0 in 0.708s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.710s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1125135182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7576e2-3b53-4256-be4d-ce0bd76b1621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412b5abca29b4f10b35db8e2b7b82acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:44Z,use_quota=True,user_id='d570f39cce444fc797345fb111d19969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Creating volume eb7576e2-3b53-4256-be4d-ce0bd76b1621 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:49 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:49 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124" returned: 0 in 0.876s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9942dee-c633-4d40-b197-ca6f86b122f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:03:49 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 1073741824 Jul 08 11:03:49 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29016a06-05df-4de1-b7a6-8ced6abae629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c794e50f-e91d-4ee1-8875-b812fed47b21', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9733264b-a91b-47c7-8383-a0c67ea65328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[140aa4ab-340d-468b-a7c0-cda5dd747eca]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:49 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Volume volume-c794e50f-e91d-4ee1-8875-b812fed47b21 (c794e50f-e91d-4ee1-8875-b812fed47b21): created successfully Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9733264b-a91b-47c7-8383-a0c67ea65328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:49 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Flow 'volume_create_manager' (074315af-1f6a-4327-90e1-044e07eb9837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:49 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-91fee004-79f2-42bf-a07a-992c24aa38a4 tempest-ProjectReaderTests-141072374 None] Created volume successfully. Jul 08 11:03:49 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 Jul 08 11:03:49 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:50 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 1073741824" returned: 0 in 0.956s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:50 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 Jul 08 11:03:50 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:50 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0" returned: 0 in 1.001s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:50 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 Jul 08 11:03:50 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Acquiring lock "cinder-c794e50f-e91d-4ee1-8875-b812fed47b21-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Lock "cinder-c794e50f-e91d-4ee1-8875-b812fed47b21-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Acquiring lock "cinder-quobyte-c794e50f-e91d-4ee1-8875-b812fed47b21" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Lock "cinder-quobyte-c794e50f-e91d-4ee1-8875-b812fed47b21" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a6bc20-dda2-45e5-8284-4132cf891c99]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:50 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21 Jul 08 11:03:50 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:50 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621" returned: 0 in 0.825s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:03:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bee126-c173-462a-8db3-9264803a2969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fdff65-5a6a-40ca-821b-893274e492ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:51 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Volume volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 (eb7576e2-3b53-4256-be4d-ce0bd76b1621): created successfully Jul 08 11:03:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fdff65-5a6a-40ca-821b-893274e492ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Flow 'volume_create_manager' (a273bf9b-49e4-4c17-aeec-6e05c3c45cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:51 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ae046925-fa9d-4a16-b1c2-49796abbc54c tempest-CinderUnicodeTest-1934744455 None] Created volume successfully. Jul 08 11:03:51 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124" returned: 0 in 1.003s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:51 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124 Jul 08 11:03:51 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:51 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21" returned: 0 in 0.985s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:51 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21 Jul 08 11:03:51 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:51 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0.257134a4-5d42-491a-be3a-c989678fb124" returned: 0 in 0.724s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-257134a4-5d42-491a-be3a-c989678fb124" released by "_delete_snapshot" :: held 3.769s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-e9942dee-c633-4d40-b197-ca6f86b122f0" released by "delete_snapshot" :: held 3.807s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Created reservations ['ee4f0729-89e6-476e-ab60-a27d05943404', '8eaa9b82-8c65-4d55-9dd9-6f1f167fcecd', 'b11e26da-ef0e-46e1-9328-78704c2d5b17', '2150731a-3483-4f99-8496-0970fc6bbfae'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] Creating offline snapshot 4e2b286c-0238-49ef-a4be-bd176e27a95e of volume eb7576e2-3b53-4256-be4d-ce0bd76b1621 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d079ed-d904-4617-98d4-3f13f04c619e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:52 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Delete snapshot completed successfully. Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-148b034b-f859-4a69-9925-4d947358f2d5 tempest-ProjectReaderTests-875080478 None] Lock "cinder-257134a4-5d42-491a-be3a-c989678fb124-delete_snapshot" released by "delete_snapshot" :: held 4.029s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:52 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-c794e50f-e91d-4ee1-8875-b812fed47b21" returned: 0 in 0.774s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Lock "cinder-quobyte-c794e50f-e91d-4ee1-8875-b812fed47b21" released by "delete_volume" :: held 1.810s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:52 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 Jul 08 11:03:52 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Created reservations ['7b4d4355-7ef4-4ea3-8913-5ac36c7a9fcf', '9d177deb-a456-4fdd-8fee-093bb61829c3', '08f7ea5f-cd3a-4aaa-a551-0baf98d87842', 'e0fc40bd-75d2-44fa-8674-9b30eb42a524'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:52 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:52 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-e9942dee-c633-4d40-b197-ca6f86b122f0-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Lock "cinder-e9942dee-c633-4d40-b197-ca6f86b122f0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-e9942dee-c633-4d40-b197-ca6f86b122f0" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-e9942dee-c633-4d40-b197-ca6f86b122f0" acquired by "delete_volume" :: waited 0.041s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecdea28-c9b1-45a1-9c98-37ac8a835e4e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:53 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 Jul 08 11:03:53 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:03:53 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Flow 'volume_create_manager' (23054f0d-1f0d-4903-b492-8b45b15c47cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:53 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2eeadb-8d0d-4f4a-8f1b-fc0972d246af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 1.023s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621" returned: 0 in 1.309s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:53 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Deleted volume successfully. Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2eeadb-8d0d-4f4a-8f1b-fc0972d246af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985678171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064968b6-e6b6-4ba4-b7ef-cbe7254d991d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6808bb5634fe4b1b84bac5c3b16951f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:53Z,use_quota=True,user_id='8f68f6b5fe354d85bcb49d16976ea5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d43c7fd-4727-4d8a-9074-d3031c197d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:53 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e 1G Jul 08 11:03:53 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d43c7fd-4727-4d8a-9074-d3031c197d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3bcd12-04f3-4952-b358-e5a383cb9bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3bcd12-04f3-4952-b358-e5a383cb9bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064968b6-e6b6-4ba4-b7ef-cbe7254d991d', 'volume_name': 'volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0f6764-cd1c-4242-9500-14af97e46c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0f6764-cd1c-4242-9500-14af97e46c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2426939-cdfc-48c8-bf2e-bd1ea4c59586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:53 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Volume 064968b6-e6b6-4ba4-b7ef-cbe7254d991d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d', 'volume_size': 1} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8e997694-ef78-470b-8005-360ad7289f31 tempest-ProjectReaderTests-141072374 None] Lock "cinder-c794e50f-e91d-4ee1-8875-b812fed47b21-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:53 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0" returned: 0 in 1.074s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:53 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0 Jul 08 11:03:53 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:53 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:53 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:54 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e 1G" returned: 0 in 0.982s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:54 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e Jul 08 11:03:54 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:54 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e9942dee-c633-4d40-b197-ca6f86b122f0" returned: 0 in 0.817s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-e9942dee-c633-4d40-b197-ca6f86b122f0" released by "delete_volume" :: held 2.031s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:DELETE=20,cinder:SELECT=142,cinder:INSERT=47,cinder:UPDATE=195 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=123,cinder:INSERT=44,cinder:UPDATE=175,cinder:DELETE=13 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Created reservations ['5133f831-7064-481a-8de7-8d48c2ffd44e', 'e9344500-38b6-445d-be12-f82bf5c67a16', 'adfe2e0b-655c-472b-b94b-609a9b3e7848', '6b318ec2-ae48-45ce-97c6-d1a3537f6ee6'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:03:54 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.915s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:54 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:03:54 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:55 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e" returned: 0 in 0.836s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:55 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e is being set with open permissions: ugo+rw Jul 08 11:03:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:55 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e Jul 08 11:03:55 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:55 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.699s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:55 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:03:55 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Deleted volume successfully. Jul 08 11:03:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-916697a0-ea8e-4309-b44a-e13102ae4745 tempest-ProjectReaderTests-875080478 None] Lock "cinder-e9942dee-c633-4d40-b197-ca6f86b122f0-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:03:56 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e" returned: 0 in 0.700s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:56 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.info Jul 08 11:03:56 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Flow 'volume_create_manager' (0f94ac60-ef11-424c-9138-249122a37a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43411b0-3ed5-473f-a162-b597b74bbc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43411b0-3ed5-473f-a162-b597b74bbc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1468852870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081d1f8b-b39f-4fcc-aca6-ef2130a78d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa76fa3faab44cbbb2388e0d44761d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:57Z,use_quota=True,user_id='5b29973515404a20a618c33ce3b081ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5872f7-84ce-4c88-b70b-8b605e941219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5872f7-84ce-4c88-b70b-8b605e941219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a72351e-f0df-4349-9f31-9af160a9bbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a72351e-f0df-4349-9f31-9af160a9bbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081d1f8b-b39f-4fcc-aca6-ef2130a78d26', 'volume_name': 'volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec9ff4e-134b-4ec3-8f4c-41c59e9c079c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec9ff4e-134b-4ec3-8f4c-41c59e9c079c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e608890e-b0f6-47b3-9f19-ca69fa18a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:56 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Volume 081d1f8b-b39f-4fcc-aca6-ef2130a78d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26', 'volume_size': 1} Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:56 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.info" returned: 0 in 0.748s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:56 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.info is being set with open permissions: ugo+rw Jul 08 11:03:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:56 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.info Jul 08 11:03:56 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:57 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.info" returned: 0 in 0.678s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.365s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.942s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985678171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064968b6-e6b6-4ba4-b7ef-cbe7254d991d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6808bb5634fe4b1b84bac5c3b16951f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:53Z,use_quota=True,user_id='8f68f6b5fe354d85bcb49d16976ea5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Creating volume 064968b6-e6b6-4ba4-b7ef-cbe7254d991d {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:57 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:03:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:57 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d 1073741824 Jul 08 11:03:57 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:57 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-299e36db-5a41-40a1-8973-af7a5d59756a tempest-CinderUnicodeTest-1934744455 None] Create snapshot completed successfully Jul 08 11:03:58 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d 1073741824" returned: 0 in 0.843s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:58 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d Jul 08 11:03:58 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "cinder-4e2b286c-0238-49ef-a4be-bd176e27a95e-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-4e2b286c-0238-49ef-a4be-bd176e27a95e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "cinder-quobyte-eb7576e2-3b53-4256-be4d-ce0bd76b1621" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-quobyte-eb7576e2-3b53-4256-be4d-ce0bd76b1621" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "cinder-quobyte-4e2b286c-0238-49ef-a4be-bd176e27a95e" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-quobyte-4e2b286c-0238-49ef-a4be-bd176e27a95e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Deleting offline snapshot 4e2b286c-0238-49ef-a4be-bd176e27a95e of volume eb7576e2-3b53-4256-be4d-ce0bd76b1621 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] snapshot_file for this snap is: volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[337edbec-19b5-416e-a12c-743f329a8f2e]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:58 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e Jul 08 11:03:58 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:59 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d" returned: 0 in 0.678s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.397s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1468852870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081d1f8b-b39f-4fcc-aca6-ef2130a78d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa76fa3faab44cbbb2388e0d44761d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:03:57Z,use_quota=True,user_id='5b29973515404a20a618c33ce3b081ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Creating volume 081d1f8b-b39f-4fcc-aca6-ef2130a78d26 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:03:59 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:59 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 1073741824 Jul 08 11:03:59 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2426939-cdfc-48c8-bf2e-bd1ea4c59586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603c40af-a801-4d28-8211-f29ea721d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:03:59 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Volume volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d (064968b6-e6b6-4ba4-b7ef-cbe7254d991d): created successfully Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603c40af-a801-4d28-8211-f29ea721d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Flow 'volume_create_manager' (23054f0d-1f0d-4903-b492-8b45b15c47cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:03:59 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-cc10180f-c2bd-468a-9ea2-cda79e2ac3c7 tempest-ProjectReaderTests-141072374 None] Created volume successfully. Jul 08 11:03:59 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e" returned: 0 in 0.817s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc7d616-804c-457e-8956-6a8773e365d2]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:03:59 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 Jul 08 11:03:59 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Acquiring lock "cinder-064968b6-e6b6-4ba4-b7ef-cbe7254d991d-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Lock "cinder-064968b6-e6b6-4ba4-b7ef-cbe7254d991d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Acquiring lock "cinder-quobyte-064968b6-e6b6-4ba4-b7ef-cbe7254d991d" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Lock "cinder-quobyte-064968b6-e6b6-4ba4-b7ef-cbe7254d991d" acquired by "delete_volume" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8908884f-d678-4042-91b5-fde759a6687c]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:03:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:00 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d Jul 08 11:04:00 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:00 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 1073741824" returned: 0 in 0.974s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:00 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 Jul 08 11:04:00 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:00 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621" returned: 0 in 0.825s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:00 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e Jul 08 11:04:00 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:00 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d" returned: 0 in 0.842s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:00 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d Jul 08 11:04:00 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:00 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26" returned: 0 in 0.684s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e608890e-b0f6-47b3-9f19-ca69fa18a17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcbbecc-c814-4b65-9678-e142dbd7150e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:00 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Volume volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 (081d1f8b-b39f-4fcc-aca6-ef2130a78d26): created successfully Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcbbecc-c814-4b65-9678-e142dbd7150e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:00 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Flow 'volume_create_manager' (0f94ac60-ef11-424c-9138-249122a37a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:00 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e453f920-521c-48eb-8944-6a73fb09ffa3 tempest-ProjectReaderTests-875080478 None] Created volume successfully. Jul 08 11:04:01 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e" returned: 0 in 0.819s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:01 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e Jul 08 11:04:01 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:01 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-064968b6-e6b6-4ba4-b7ef-cbe7254d991d" returned: 0 in 0.678s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Lock "cinder-quobyte-064968b6-e6b6-4ba4-b7ef-cbe7254d991d" released by "delete_volume" :: held 1.564s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Created reservations ['dd32420d-7941-4d7b-b462-ceb9fcbf8cda', '2222ce78-50f2-4fc1-b58a-162c1ca0f9eb', '9e79d60d-bf4a-4ee6-82f7-73c4cb37d9ae', 'ff2393e6-548f-4b58-a317-08ce83f0a181'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:01 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:04:01 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:01 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621.4e2b286c-0238-49ef-a4be-bd176e27a95e" returned: 0 in 0.697s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-quobyte-4e2b286c-0238-49ef-a4be-bd176e27a95e" released by "_delete_snapshot" :: held 3.284s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-quobyte-eb7576e2-3b53-4256-be4d-ce0bd76b1621" released by "delete_snapshot" :: held 3.313s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Created reservations ['c66cef92-17e3-48a4-be46-c2f1c15d2da1', '71f19d4b-6ac2-41af-b6d6-cda7a89db828', '5871b73a-c442-4408-bb15-7969c5511261', '99992b30-7b74-41e4-8ed1-995c7897b43c'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] Creating offline snapshot efe1fc54-37f9-4d66-89bf-d82d253a54cd of volume 081d1f8b-b39f-4fcc-aca6-ef2130a78d26 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:04:02 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Delete snapshot completed successfully. Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[821b1975-75c7-483b-be21-9ad6bebe7f60]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-52839613-ed48-49c1-82a2-01a55f922d61 tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-4e2b286c-0238-49ef-a4be-bd176e27a95e-delete_snapshot" released by "delete_snapshot" :: held 3.552s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:02 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 Jul 08 11:04:02 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:02 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.710s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:04:02 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Deleted volume successfully. Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-20dc25a4-b452-4ee1-b26e-3bbb03a3f045 tempest-ProjectReaderTests-141072374 None] Lock "cinder-064968b6-e6b6-4ba4-b7ef-cbe7254d991d-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "cinder-eb7576e2-3b53-4256-be4d-ce0bd76b1621-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-eb7576e2-3b53-4256-be4d-ce0bd76b1621-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "cinder-quobyte-eb7576e2-3b53-4256-be4d-ce0bd76b1621" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-quobyte-eb7576e2-3b53-4256-be4d-ce0bd76b1621" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:02 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26" returned: 0 in 0.840s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[65521216-d620-476c-9371-996064c726ee]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:02 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd 1G Jul 08 11:04:02 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:03 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 Jul 08 11:04:03 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:03 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621" returned: 0 in 0.867s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:03 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621 Jul 08 11:04:03 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:03 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd 1G" returned: 0 in 0.966s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:03 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd Jul 08 11:04:03 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:04 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-eb7576e2-3b53-4256-be4d-ce0bd76b1621" returned: 0 in 0.667s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:04 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-quobyte-eb7576e2-3b53-4256-be4d-ce0bd76b1621" released by "delete_volume" :: held 1.614s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:04 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Created reservations ['f73cfd80-30a5-4a53-a4e5-b356af50ec11', '6245f850-3418-45f1-83a0-fc9c7fe5b8ee', '97ccf237-234d-4a7c-a4f9-f5662305e3eb', '8afd9313-4f2c-4957-8a0b-58eb431264aa'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:04 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd" returned: 0 in 0.725s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:04 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd is being set with open permissions: ugo+rw Jul 08 11:04:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:04 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:04:04 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:04 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd Jul 08 11:04:04 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "cinder-96583249-2196-40f8-b827-424f35796f99-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-96583249-2196-40f8-b827-424f35796f99-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "cinder-quobyte-96583249-2196-40f8-b827-424f35796f99" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-quobyte-96583249-2196-40f8-b827-424f35796f99" acquired by "delete_volume" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[421e61d7-b729-4084-a6da-e0d4dc72fb2f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:05 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.680s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:04:05 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Deleted volume successfully. Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd" returned: 0 in 0.686s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:05 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99 Jul 08 11:04:05 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-657451ea-1152-43a9-b422-3e61e934950a tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-eb7576e2-3b53-4256-be4d-ce0bd76b1621-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:05 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.info Jul 08 11:04:05 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:05 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99" returned: 0 in 0.811s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:05 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:05 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99 Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.info" returned: 0 in 0.700s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:05 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.info is being set with open permissions: ugo+rw Jul 08 11:04:05 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:06 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.info Jul 08 11:04:06 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:06 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-96583249-2196-40f8-b827-424f35796f99" returned: 0 in 0.659s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:06 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.info" returned: 0 in 0.642s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.685s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-quobyte-96583249-2196-40f8-b827-424f35796f99" released by "delete_volume" :: held 1.557s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:06 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5bc7d4e7-35fe-4d9e-9c24-1d82782f6e80 tempest-ProjectReaderTests-875080478 None] Create snapshot completed successfully Jul 08 11:04:06 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Created reservations ['06cdb838-196b-4e92-bb45-c647bebf03df', 'f8959b92-df94-4367-9653-283eec397034', 'cbd1f8a9-eb9d-40b2-b064-c1bf1f51bed6', 'd8242a68-4f00-40d0-b8f3-30e0160a6ec8'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:06 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:06 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:04:06 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-efe1fc54-37f9-4d66-89bf-d82d253a54cd-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Lock "cinder-efe1fc54-37f9-4d66-89bf-d82d253a54cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-081d1f8b-b39f-4fcc-aca6-ef2130a78d26" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-081d1f8b-b39f-4fcc-aca6-ef2130a78d26" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-efe1fc54-37f9-4d66-89bf-d82d253a54cd" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-efe1fc54-37f9-4d66-89bf-d82d253a54cd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Deleting offline snapshot efe1fc54-37f9-4d66-89bf-d82d253a54cd of volume 081d1f8b-b39f-4fcc-aca6-ef2130a78d26 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] snapshot_file for this snap is: volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de70dfd-424a-4fc0-b7d3-ab2d96c109f3]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:07 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.660s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:04:07 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Deleted volume successfully. Jul 08 11:04:07 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd Jul 08 11:04:07 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-808ee1fd-d472-4706-a03e-811490eba7a4 tempest-CinderUnicodeTest-1934744455 None] Lock "cinder-96583249-2196-40f8-b827-424f35796f99-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:08 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd" returned: 0 in 0.843s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:04:08 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb174c3-3fd8-42d9-9350-7d1277d65482]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:08 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 Jul 08 11:04:08 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:09 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26" returned: 0 in 0.791s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:09 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd Jul 08 11:04:09 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:09 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd" returned: 0 in 0.764s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:09 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd Jul 08 11:04:09 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:10 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26.efe1fc54-37f9-4d66-89bf-d82d253a54cd" returned: 0 in 0.694s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-efe1fc54-37f9-4d66-89bf-d82d253a54cd" released by "_delete_snapshot" :: held 3.212s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-081d1f8b-b39f-4fcc-aca6-ef2130a78d26" released by "delete_snapshot" :: held 3.242s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Created reservations ['0e757b4a-7c6d-4ec6-b759-44fcd959d610', 'ca38a40a-0c39-4c0a-b747-1af6a216f4cf', '4ec316f1-f861-4737-8c91-b55e5b5db95e', '7f6b2b4e-abe7-4b92-94c8-4d4d40d2a89b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:10 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Delete snapshot completed successfully. Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a0c81a06-c3f3-47a1-8410-febd5cda257c tempest-ProjectReaderTests-875080478 None] Lock "cinder-efe1fc54-37f9-4d66-89bf-d82d253a54cd-delete_snapshot" released by "delete_snapshot" :: held 3.418s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (0683d136-0591-4443-9c2b-054b9a720f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9723dab5-553d-4a59-938b-2fda7218685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9723dab5-553d-4a59-938b-2fda7218685f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-608014634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e685a4-aaf1-4bc5-9316-c73682c4b595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:11Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d3674f-a536-43b7-bb8a-b8c27701fc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d3674f-a536-43b7-bb8a-b8c27701fc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd454d8-f0b9-43c8-adc8-543fcd85ad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd454d8-f0b9-43c8-adc8-543fcd85ad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e685a4-aaf1-4bc5-9316-c73682c4b595', 'volume_name': 'volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa28587-edc0-43fc-b778-4e55a3fb8533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa28587-edc0-43fc-b778-4e55a3fb8533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20668633-051d-4b89-ab31-f99d1415d7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:10 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Volume f0e685a4-aaf1-4bc5-9316-c73682c4b595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595', 'volume_size': 1} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-608014634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e685a4-aaf1-4bc5-9316-c73682c4b595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:11Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Creating volume f0e685a4-aaf1-4bc5-9316-c73682c4b595 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:04:10 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:04:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:10 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 1073741824 Jul 08 11:04:10 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-081d1f8b-b39f-4fcc-aca6-ef2130a78d26-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Lock "cinder-081d1f8b-b39f-4fcc-aca6-ef2130a78d26-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-081d1f8b-b39f-4fcc-aca6-ef2130a78d26" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:11 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-081d1f8b-b39f-4fcc-aca6-ef2130a78d26" acquired by "delete_volume" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:11 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f664e1-9a00-480d-b04f-5ec843a8439a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:11 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 Jul 08 11:04:11 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:11 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 1073741824" returned: 0 in 0.948s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:11 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 Jul 08 11:04:11 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:12 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26" returned: 0 in 0.747s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:12 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26 Jul 08 11:04:12 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:12 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595" returned: 0 in 0.692s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:12 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:04:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20668633-051d-4b89-ab31-f99d1415d7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1f4b1b-bd49-445e-9d61-f8e394130428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:12 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Volume volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 (f0e685a4-aaf1-4bc5-9316-c73682c4b595): created successfully Jul 08 11:04:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1f4b1b-bd49-445e-9d61-f8e394130428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:12 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (0683d136-0591-4443-9c2b-054b9a720f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:12 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-24c9cd27-95c0-408e-9150-0b463f2ffc44 tempest-ProjectMemberTests-1421652484 None] Created volume successfully. Jul 08 11:04:13 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-081d1f8b-b39f-4fcc-aca6-ef2130a78d26" returned: 0 in 0.685s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-081d1f8b-b39f-4fcc-aca6-ef2130a78d26" released by "delete_volume" :: held 1.495s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] Creating offline snapshot 60b682b3-1796-4d4f-80db-41941b39e7e1 of volume f0e685a4-aaf1-4bc5-9316-c73682c4b595 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Created reservations ['88e8d6ea-f1c4-4c0d-858b-0b41d8250191', '5b949637-6b40-4dbd-bbf7-5d1bfe1331b5', 'c3c8b303-6552-4046-bdf6-1f3a6d8a9dc0', 'e1f6f0f8-43ce-47e2-bf18-8e0798373b06'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef9d60c-031c-4d45-8298-0726db10d740]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:13 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:04:13 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:13 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 Jul 08 11:04:13 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:13 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.695s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:04:13 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Deleted volume successfully. Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-944c98ee-80cb-4055-8900-1cc7a61e9873 tempest-ProjectReaderTests-875080478 None] Lock "cinder-081d1f8b-b39f-4fcc-aca6-ef2130a78d26-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:13 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595" returned: 0 in 0.842s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:14 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 1G Jul 08 11:04:14 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Flow 'volume_create_manager' (2153847e-ff02-4505-befe-4ca97d86c4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b188dca-65d7-4436-88ef-7ba58aea1e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b188dca-65d7-4436-88ef-7ba58aea1e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316119900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4b3318-1b03-4519-83de-531990806340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa76fa3faab44cbbb2388e0d44761d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:14Z,use_quota=True,user_id='5b29973515404a20a618c33ce3b081ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18826ec-9a4b-4ab7-b01f-0123d172fc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18826ec-9a4b-4ab7-b01f-0123d172fc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63d6573-60e0-4b8f-985b-4a3d5c8c942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63d6573-60e0-4b8f-985b-4a3d5c8c942f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe4b3318-1b03-4519-83de-531990806340', 'volume_name': 'volume-fe4b3318-1b03-4519-83de-531990806340', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231cdcd1-6837-4b91-9548-4e5d1cb499cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231cdcd1-6837-4b91-9548-4e5d1cb499cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28267177-5003-4e13-92ee-fb7d13ef8305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:14 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Volume fe4b3318-1b03-4519-83de-531990806340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe4b3318-1b03-4519-83de-531990806340', 'volume_size': 1} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:14 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 1G" returned: 0 in 0.840s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:14 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 Jul 08 11:04:14 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:15 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1" returned: 0 in 0.713s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:15 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 is being set with open permissions: ugo+rw Jul 08 11:04:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:15 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 Jul 08 11:04:15 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:16 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1" returned: 0 in 0.650s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:16 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.info Jul 08 11:04:16 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:16 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.info" returned: 0 in 0.650s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:16 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.info is being set with open permissions: ugo+rw Jul 08 11:04:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:16 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.info Jul 08 11:04:16 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:17 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.info" returned: 0 in 0.634s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.423s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.257s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316119900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4b3318-1b03-4519-83de-531990806340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa76fa3faab44cbbb2388e0d44761d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:14Z,use_quota=True,user_id='5b29973515404a20a618c33ce3b081ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Creating volume fe4b3318-1b03-4519-83de-531990806340 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:04:17 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:04:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:17 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 1073741824 Jul 08 11:04:17 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:17 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-feff21b8-2c14-4606-9586-1939eee88b17 tempest-ProjectMemberTests-1421652484 None] Create snapshot completed successfully Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-60b682b3-1796-4d4f-80db-41941b39e7e1-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-60b682b3-1796-4d4f-80db-41941b39e7e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-f0e685a4-aaf1-4bc5-9316-c73682c4b595" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-f0e685a4-aaf1-4bc5-9316-c73682c4b595" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:18 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-60b682b3-1796-4d4f-80db-41941b39e7e1" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 1073741824" returned: 0 in 0.841s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-60b682b3-1796-4d4f-80db-41941b39e7e1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Deleting offline snapshot 60b682b3-1796-4d4f-80db-41941b39e7e1 of volume f0e685a4-aaf1-4bc5-9316-c73682c4b595 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] snapshot_file for this snap is: volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2103203b-a170-4e8a-a0ee-dc30eaed401d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:18 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 Jul 08 11:04:18 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:18 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 Jul 08 11:04:18 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:19 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340" returned: 0 in 0.665s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28267177-5003-4e13-92ee-fb7d13ef8305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe4b3318-1b03-4519-83de-531990806340', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc678f6-a838-422f-be48-d3624e600b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:19 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Volume volume-fe4b3318-1b03-4519-83de-531990806340 (fe4b3318-1b03-4519-83de-531990806340): created successfully Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc678f6-a838-422f-be48-d3624e600b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Flow 'volume_create_manager' (2153847e-ff02-4505-befe-4ca97d86c4b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:19 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-043ee11f-3418-4496-81ec-98358a2c970e tempest-ProjectReaderTests-875080478 None] Created volume successfully. Jul 08 11:04:19 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1" returned: 0 in 0.825s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[d470a8fa-f78a-485c-914f-c0dd1d3b8a65]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:19 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 Jul 08 11:04:19 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] Creating offline snapshot 2fa856c7-ffc0-4df6-978d-51dbdc7b6787 of volume fe4b3318-1b03-4519-83de-531990806340 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[16658628-2770-44f0-9095-7ec9515f3405]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:19 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 Jul 08 11:04:19 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:20 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595" returned: 0 in 0.837s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:20 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 Jul 08 11:04:20 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:20 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340" returned: 0 in 0.803s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:20 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 1G Jul 08 11:04:20 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:20 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1" returned: 0 in 0.804s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:20 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1 Jul 08 11:04:20 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:21 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 1G" returned: 0 in 0.816s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4b3318-1b03-4519-83de-531990806340 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:21 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4b3318-1b03-4519-83de-531990806340 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 Jul 08 11:04:21 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:21 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595.60b682b3-1796-4d4f-80db-41941b39e7e1" returned: 0 in 0.673s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-60b682b3-1796-4d4f-80db-41941b39e7e1" released by "_delete_snapshot" :: held 3.278s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-f0e685a4-aaf1-4bc5-9316-c73682c4b595" released by "delete_snapshot" :: held 3.312s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:21 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Created reservations ['5669c9c4-3367-4e36-814e-30679eda38a1', '6800b2ec-6d8f-4d65-a37d-daa3e3e2dd41', '1fe6b0f0-fbd2-4662-9298-f034f4ec2c99', '9cb19e60-6d4f-4933-879e-6ba594d2a1f3'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:21 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Delete snapshot completed successfully. Jul 08 11:04:21 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-221c531d-8cf8-437c-ad6b-9294a6f708e7 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-60b682b3-1796-4d4f-80db-41941b39e7e1-delete_snapshot" released by "delete_snapshot" :: held 3.457s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:22 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4b3318-1b03-4519-83de-531990806340 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787" returned: 0 in 0.709s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:22 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 is being set with open permissions: ugo+rw Jul 08 11:04:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:22 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 Jul 08 11:04:22 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:22 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-f0e685a4-aaf1-4bc5-9316-c73682c4b595-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:22 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Lock "cinder-f0e685a4-aaf1-4bc5-9316-c73682c4b595-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:22 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-f0e685a4-aaf1-4bc5-9316-c73682c4b595" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:22 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-f0e685a4-aaf1-4bc5-9316-c73682c4b595" acquired by "delete_volume" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:22 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787" returned: 0 in 0.699s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:22 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6850d526-70ef-4633-a683-c7bb8669300f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:22 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.info Jul 08 11:04:22 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:22 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 Jul 08 11:04:22 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:23 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.info" returned: 0 in 0.742s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:23 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.info is being set with open permissions: ugo+rw Jul 08 11:04:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:23 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595" returned: 0 in 0.786s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:23 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.info Jul 08 11:04:23 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:23 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595 Jul 08 11:04:23 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:24 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.info" returned: 0 in 0.674s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.538s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:24 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-f0e685a4-aaf1-4bc5-9316-c73682c4b595" returned: 0 in 0.720s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-f0e685a4-aaf1-4bc5-9316-c73682c4b595" released by "delete_volume" :: held 1.590s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:24 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e7b6987e-4839-4469-b173-0b1a4c29d3e0 tempest-ProjectReaderTests-875080478 None] Create snapshot completed successfully Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Created reservations ['db8b2a02-49c3-44c1-9f25-2375480b8954', 'a94daa0d-b425-4848-903c-65984885b908', '2f5363a1-122e-4256-a215-d52c20d49a7c', 'fdf5a2da-1ffa-4c1b-9bd0-c667fd23d7a9'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:24 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:04:24 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-2fa856c7-ffc0-4df6-978d-51dbdc7b6787-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Lock "cinder-2fa856c7-ffc0-4df6-978d-51dbdc7b6787-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-fe4b3318-1b03-4519-83de-531990806340" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-fe4b3318-1b03-4519-83de-531990806340" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-2fa856c7-ffc0-4df6-978d-51dbdc7b6787" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-2fa856c7-ffc0-4df6-978d-51dbdc7b6787" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Deleting offline snapshot 2fa856c7-ffc0-4df6-978d-51dbdc7b6787 of volume fe4b3318-1b03-4519-83de-531990806340 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] snapshot_file for this snap is: volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b3866a-2613-4d8a-afda-592e1304b9ba]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:25 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.736s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:04:25 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Deleted volume successfully. Jul 08 11:04:25 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 Jul 08 11:04:25 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5dc7d480-7e38-4e2e-8ae7-0a35d67c77cd tempest-ProjectMemberTests-1421652484 None] Lock "cinder-f0e685a4-aaf1-4bc5-9316-c73682c4b595-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (416956e4-20aa-49c7-997f-50d5e02c79ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d8b0d4-ed46-4700-a1ea-bddc84a63236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d8b0d4-ed46-4700-a1ea-bddc84a63236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1688202303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c5a5da-53e6-4e8f-ac9a-73f3127c023e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:25Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33808c2e-1945-4b5b-94be-64f2aaad0360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33808c2e-1945-4b5b-94be-64f2aaad0360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3511b0b-1c28-4f7e-9710-736e70e77f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3511b0b-1c28-4f7e-9710-736e70e77f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c5a5da-53e6-4e8f-ac9a-73f3127c023e', 'volume_name': 'volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec609e8-f408-41f4-990b-5b1d41636571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec609e8-f408-41f4-990b-5b1d41636571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa676a0f-ede4-4fd5-83c6-0596cdbc357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:25 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Volume 83c5a5da-53e6-4e8f-ac9a-73f3127c023e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e', 'volume_size': 1} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1688202303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c5a5da-53e6-4e8f-ac9a-73f3127c023e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:25Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Creating volume 83c5a5da-53e6-4e8f-ac9a-73f3127c023e {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:04:25 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:25 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e 1073741824 Jul 08 11:04:25 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:25 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787" returned: 0 in 0.876s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe4b3318-1b03-4519-83de-531990806340(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e4a391-793e-4a8a-aac1-9cee591ee929]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:26 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 Jul 08 11:04:26 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:26 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e 1073741824" returned: 0 in 0.887s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:26 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e Jul 08 11:04:26 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:26 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340" returned: 0 in 0.778s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:26 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 Jul 08 11:04:26 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:27 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e" returned: 0 in 0.688s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa676a0f-ede4-4fd5-83c6-0596cdbc357f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331ba598-93e5-421d-977a-97a14121f661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:27 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Volume volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e (83c5a5da-53e6-4e8f-ac9a-73f3127c023e): created successfully Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331ba598-93e5-421d-977a-97a14121f661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (416956e4-20aa-49c7-997f-50d5e02c79ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:27 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a0577ea2-1955-4e05-9b51-21557dd9a76f tempest-ProjectMemberTests-1421652484 None] Created volume successfully. Jul 08 11:04:27 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787" returned: 0 in 0.826s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:27 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787 Jul 08 11:04:27 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] Creating offline snapshot 4fcc3d93-7b15-43e1-b677-5b2232c000de of volume 83c5a5da-53e6-4e8f-ac9a-73f3127c023e {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29d3db5-0107-42f3-a09f-ea5bd3d5c39b]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:27 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e Jul 08 11:04:27 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:28 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340.2fa856c7-ffc0-4df6-978d-51dbdc7b6787" returned: 0 in 0.668s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-2fa856c7-ffc0-4df6-978d-51dbdc7b6787" released by "_delete_snapshot" :: held 3.273s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-fe4b3318-1b03-4519-83de-531990806340" released by "delete_snapshot" :: held 3.301s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:28 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Created reservations ['a438ed43-3272-4083-987b-665af3bd92f4', 'b3afcee5-1b8a-4951-94fb-41ac33f4599d', '2958a538-a30c-419f-ad8a-7c6b72e52e20', 'e8b0e961-e36d-4616-a2dc-9bd85a460d52'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:28 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Delete snapshot completed successfully. Jul 08 11:04:28 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-ed68b2a7-b91d-4790-aa25-359262118d88 tempest-ProjectReaderTests-875080478 None] Lock "cinder-2fa856c7-ffc0-4df6-978d-51dbdc7b6787-delete_snapshot" released by "delete_snapshot" :: held 3.443s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:28 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e" returned: 0 in 0.790s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:28 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de 1G Jul 08 11:04:28 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-fe4b3318-1b03-4519-83de-531990806340-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Lock "cinder-fe4b3318-1b03-4519-83de-531990806340-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-fe4b3318-1b03-4519-83de-531990806340" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:29 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:29 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-fe4b3318-1b03-4519-83de-531990806340" acquired by "delete_volume" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de 1G" returned: 0 in 0.817s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:29 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4d41c2-41c2-4a8d-b096-ee4f0cbd038a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:29 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de Jul 08 11:04:29 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:29 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 Jul 08 11:04:29 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:29 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de" returned: 0 in 0.682s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:29 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de is being set with open permissions: ugo+rw Jul 08 11:04:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:29 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de Jul 08 11:04:29 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:30 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340" returned: 0 in 0.807s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:30 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340 Jul 08 11:04:30 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:30 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de" returned: 0 in 0.691s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:30 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.info Jul 08 11:04:30 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:30 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-fe4b3318-1b03-4519-83de-531990806340" returned: 0 in 0.677s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-fe4b3318-1b03-4519-83de-531990806340" released by "delete_volume" :: held 1.543s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Created reservations ['d99f5198-6a01-4220-b752-de0c041a91c0', '181cf4ef-22d5-47df-9cfd-e843810a2c58', 'aef578de-cf04-4d1e-8e72-cf8fee4e351f', 'de44efb1-35a0-4b61-87c5-ad2a3d911d4b'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:30 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:04:30 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:31 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.info" returned: 0 in 0.643s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:31 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.info is being set with open permissions: ugo+rw Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:31 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.info Jul 08 11:04:31 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:31 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.682s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:04:31 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Deleted volume successfully. Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-9c387d6d-4e43-4f37-b206-a0f6ca6658a6 tempest-ProjectReaderTests-875080478 None] Lock "cinder-fe4b3318-1b03-4519-83de-531990806340-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Flow 'volume_create_manager' (fdaf12c1-aa9b-4c0a-98ac-c9bbbb649196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c0393a-2514-4e50-a077-d1a106125f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c0393a-2514-4e50-a077-d1a106125f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574144638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8278b0b7-2c76-41ba-a582-a588b4dfa342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa76fa3faab44cbbb2388e0d44761d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:32Z,use_quota=True,user_id='5b29973515404a20a618c33ce3b081ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d33f34-6c5a-477c-8d34-968fc8e92e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d33f34-6c5a-477c-8d34-968fc8e92e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:31 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850467a5-a078-4a7f-8536-ff35d9ae0a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850467a5-a078-4a7f-8536-ff35d9ae0a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8278b0b7-2c76-41ba-a582-a588b4dfa342', 'volume_name': 'volume-8278b0b7-2c76-41ba-a582-a588b4dfa342', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef817e1-5205-47db-b0ea-1fc74cc24fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef817e1-5205-47db-b0ea-1fc74cc24fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c19d72-34e8-4e9c-ba76-be63077b22ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:31 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Volume 8278b0b7-2c76-41ba-a582-a588b4dfa342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8278b0b7-2c76-41ba-a582-a588b4dfa342', 'volume_size': 1} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.info" returned: 0 in 0.659s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.367s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574144638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8278b0b7-2c76-41ba-a582-a588b4dfa342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa76fa3faab44cbbb2388e0d44761d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:32Z,use_quota=True,user_id='5b29973515404a20a618c33ce3b081ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Creating volume 8278b0b7-2c76-41ba-a582-a588b4dfa342 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:04:31 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:04:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:31 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 1073741824 Jul 08 11:04:31 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:31 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-702b32e3-999d-4885-a195-5aec0b6659b0 tempest-ProjectMemberTests-1421652484 None] Create snapshot completed successfully Jul 08 11:04:32 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 1073741824" returned: 0 in 0.816s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-4fcc3d93-7b15-43e1-b677-5b2232c000de-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-4fcc3d93-7b15-43e1-b677-5b2232c000de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-83c5a5da-53e6-4e8f-ac9a-73f3127c023e" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-83c5a5da-53e6-4e8f-ac9a-73f3127c023e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-4fcc3d93-7b15-43e1-b677-5b2232c000de" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:32 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 Jul 08 11:04:32 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-4fcc3d93-7b15-43e1-b677-5b2232c000de" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Deleting offline snapshot 4fcc3d93-7b15-43e1-b677-5b2232c000de of volume 83c5a5da-53e6-4e8f-ac9a-73f3127c023e {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] snapshot_file for this snap is: volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c509b9a-902a-43e6-a092-20fa3fd43317]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:33 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de Jul 08 11:04:33 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:33 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342" returned: 0 in 0.645s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:04:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c19d72-34e8-4e9c-ba76-be63077b22ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8278b0b7-2c76-41ba-a582-a588b4dfa342', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9811502-9508-4e08-b2c6-c358f25626ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:33 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Volume volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 (8278b0b7-2c76-41ba-a582-a588b4dfa342): created successfully Jul 08 11:04:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9811502-9508-4e08-b2c6-c358f25626ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:33 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Flow 'volume_create_manager' (fdaf12c1-aa9b-4c0a-98ac-c9bbbb649196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:33 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-0c435c92-1d05-4942-a66d-c8d675a9448a tempest-ProjectReaderTests-875080478 None] Created volume successfully. Jul 08 11:04:33 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de" returned: 0 in 0.773s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:33 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:04:33 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66251df-6bf0-4431-b44b-6d73966f441a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:33 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e Jul 08 11:04:33 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:34 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] Creating offline snapshot 2690b48b-10f3-4024-8c08-1fec1ec6682c of volume 8278b0b7-2c76-41ba-a582-a588b4dfa342 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:04:34 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde1ebc0-c6d0-451c-bda4-6d50a53343b7]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:34 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 Jul 08 11:04:34 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:34 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e" returned: 0 in 0.782s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:34 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de Jul 08 11:04:34 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:34 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342" returned: 0 in 0.763s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:34 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c 1G Jul 08 11:04:34 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:35 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de" returned: 0 in 0.745s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:35 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de Jul 08 11:04:35 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:35 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c 1G" returned: 0 in 0.835s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:35 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c Jul 08 11:04:35 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:35 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e.4fcc3d93-7b15-43e1-b677-5b2232c000de" returned: 0 in 0.767s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-4fcc3d93-7b15-43e1-b677-5b2232c000de" released by "_delete_snapshot" :: held 3.179s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-83c5a5da-53e6-4e8f-ac9a-73f3127c023e" released by "delete_snapshot" :: held 3.208s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:36 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Created reservations ['0f4d9320-9fc6-49f6-9b03-84b0cc530cd8', '5df59efb-067b-4e34-9d66-b49b10e3abcf', '633694ef-7038-43ab-a99f-0f8ecb42b45f', '18c47a0e-f7f3-48e8-b53c-40cba2a8403f'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:36 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Delete snapshot completed successfully. Jul 08 11:04:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-2ebbef20-22d7-482d-84d8-1500e8dfd309 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-4fcc3d93-7b15-43e1-b677-5b2232c000de-delete_snapshot" released by "delete_snapshot" :: held 3.378s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:36 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c" returned: 0 in 0.757s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:36 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c is being set with open permissions: ugo+rw Jul 08 11:04:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:36 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c Jul 08 11:04:36 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-83c5a5da-53e6-4e8f-ac9a-73f3127c023e-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Lock "cinder-83c5a5da-53e6-4e8f-ac9a-73f3127c023e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:37 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c" returned: 0 in 0.678s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-83c5a5da-53e6-4e8f-ac9a-73f3127c023e" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:37 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.info Jul 08 11:04:37 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:37 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-83c5a5da-53e6-4e8f-ac9a-73f3127c023e" acquired by "delete_volume" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:37 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6eaa3b-cbb5-41f1-91fd-225d079432b0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:37 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e Jul 08 11:04:37 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:37 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.info" returned: 0 in 0.659s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:37 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.info is being set with open permissions: ugo+rw Jul 08 11:04:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:37 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.info Jul 08 11:04:37 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:38 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e" returned: 0 in 0.819s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:38 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e Jul 08 11:04:38 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:38 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.info" returned: 0 in 0.688s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.468s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:38 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-e648c20a-46b8-49d4-bb20-6fd350713f61 tempest-ProjectReaderTests-875080478 None] Create snapshot completed successfully Jul 08 11:04:38 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-83c5a5da-53e6-4e8f-ac9a-73f3127c023e" returned: 0 in 0.711s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-83c5a5da-53e6-4e8f-ac9a-73f3127c023e" released by "delete_volume" :: held 1.591s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Created reservations ['5c079ff9-f3ef-46c8-a9f0-560ded259adf', '23d1f2c5-7ee0-43f2-a8c2-dd46db6e07ab', '4211de2a-1a60-47f9-a4aa-fb3694091a2d', '1be5b297-753f-4a57-a509-e2d129716328'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:38 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:04:38 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-2690b48b-10f3-4024-8c08-1fec1ec6682c-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Lock "cinder-2690b48b-10f3-4024-8c08-1fec1ec6682c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-8278b0b7-2c76-41ba-a582-a588b4dfa342" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-8278b0b7-2c76-41ba-a582-a588b4dfa342" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-2690b48b-10f3-4024-8c08-1fec1ec6682c" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-2690b48b-10f3-4024-8c08-1fec1ec6682c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Deleting offline snapshot 2690b48b-10f3-4024-8c08-1fec1ec6682c of volume 8278b0b7-2c76-41ba-a582-a588b4dfa342 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] snapshot_file for this snap is: volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[204ae46c-7c3d-48ef-b634-70f0b62fdae8]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:39 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c Jul 08 11:04:39 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:39 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.675s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:04:39 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Deleted volume successfully. Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-641630c5-6be8-41be-ad3e-4a6a2530638d tempest-ProjectMemberTests-1421652484 None] Lock "cinder-83c5a5da-53e6-4e8f-ac9a-73f3127c023e-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (118a60f0-1941-44c0-8009-5882739cb673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da43ded-7056-4da7-bb5a-b629aea6e3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da43ded-7056-4da7-bb5a-b629aea6e3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1790710926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7710b2e7-f028-4f90-9d9e-9e8d544fc432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:40Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de3f6f9-2c7c-4ef7-99fc-4d1f38ba2ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de3f6f9-2c7c-4ef7-99fc-4d1f38ba2ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81dd1d0-68e9-4cab-89c9-c79467a4af01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81dd1d0-68e9-4cab-89c9-c79467a4af01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7710b2e7-f028-4f90-9d9e-9e8d544fc432', 'volume_name': 'volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5765aee1-4fb8-4787-af70-20fb2f26b922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5765aee1-4fb8-4787-af70-20fb2f26b922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c99cc83-0ea2-4a6c-83db-94c33a41d08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:39 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Volume 7710b2e7-f028-4f90-9d9e-9e8d544fc432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432', 'volume_size': 1} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1790710926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7710b2e7-f028-4f90-9d9e-9e8d544fc432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:40Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Creating volume 7710b2e7-f028-4f90-9d9e-9e8d544fc432 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:04:39 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:04:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:39 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 1073741824 Jul 08 11:04:39 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:40 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c" returned: 0 in 0.859s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:40 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8278b0b7-2c76-41ba-a582-a588b4dfa342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:04:40 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8012269-3614-47d7-9a8f-5d211adf7837]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:40 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 Jul 08 11:04:40 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:40 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 1073741824" returned: 0 in 0.828s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:40 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 Jul 08 11:04:40 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:41 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342" returned: 0 in 0.859s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:41 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c Jul 08 11:04:41 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:41 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432" returned: 0 in 0.694s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:41 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:04:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c99cc83-0ea2-4a6c-83db-94c33a41d08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ecd103-e005-419a-ac3b-5722c6ea5676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:41 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Volume volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 (7710b2e7-f028-4f90-9d9e-9e8d544fc432): created successfully Jul 08 11:04:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ecd103-e005-419a-ac3b-5722c6ea5676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:41 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (118a60f0-1941-44c0-8009-5882739cb673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:41 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-695bc3d3-41f0-4fd9-8bf8-d7067817a7fd tempest-ProjectMemberTests-1421652484 None] Created volume successfully. Jul 08 11:04:41 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c" returned: 0 in 0.741s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:41 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c Jul 08 11:04:41 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] Creating offline snapshot 2cb734c7-4124-4d73-a5f4-09f3c1c879bd of volume 7710b2e7-f028-4f90-9d9e-9e8d544fc432 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec70fea6-307f-41d5-99e2-d02a4bc9d8be]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:42 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 Jul 08 11:04:42 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:42 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342.2690b48b-10f3-4024-8c08-1fec1ec6682c" returned: 0 in 0.671s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-2690b48b-10f3-4024-8c08-1fec1ec6682c" released by "_delete_snapshot" :: held 3.234s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-8278b0b7-2c76-41ba-a582-a588b4dfa342" released by "delete_snapshot" :: held 3.257s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Created reservations ['8f39a1a2-1461-4d3f-8e4b-f2df177401ee', '3f55f3d1-546a-4e02-bd4f-a9ff058d9d54', '02d56433-d74a-47d3-b1ef-f9b784ae0375', 'b57a5d5e-033a-4c75-b642-7aa09ddb6879'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:42 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Delete snapshot completed successfully. Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb9ab0b3-170b-4a85-94dd-ba672f58251a tempest-ProjectReaderTests-875080478 None] Lock "cinder-2690b48b-10f3-4024-8c08-1fec1ec6682c-delete_snapshot" released by "delete_snapshot" :: held 3.410s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:42 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432" returned: 0 in 0.774s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:43 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd 1G Jul 08 11:04:43 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-8278b0b7-2c76-41ba-a582-a588b4dfa342-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Lock "cinder-8278b0b7-2c76-41ba-a582-a588b4dfa342-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-8278b0b7-2c76-41ba-a582-a588b4dfa342" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:43 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-8278b0b7-2c76-41ba-a582-a588b4dfa342" acquired by "delete_volume" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:43 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[926f4dea-de05-466e-b285-4b3f1f3079b5]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:43 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 Jul 08 11:04:43 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:43 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd 1G" returned: 0 in 0.901s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:43 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd Jul 08 11:04:43 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:44 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342" returned: 0 in 0.831s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:44 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd" returned: 0 in 0.693s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:44 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd is being set with open permissions: ugo+rw Jul 08 11:04:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:44 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342 Jul 08 11:04:44 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:44 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd Jul 08 11:04:44 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:45 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8278b0b7-2c76-41ba-a582-a588b4dfa342" returned: 0 in 0.684s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:45 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd" returned: 0 in 0.685s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-8278b0b7-2c76-41ba-a582-a588b4dfa342" released by "delete_volume" :: held 1.579s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:45 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.info Jul 08 11:04:45 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Created reservations ['18871b6c-7c05-49ce-995a-75b6d4c78a4e', 'cfcab3cc-b99d-4252-9625-e9602f60be1b', '4f035398-2273-4306-a8ae-f6caa28de464', '2ed4afb8-84dc-4840-8e67-da8b73f2f43f'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:45 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:04:45 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:45 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.info" returned: 0 in 0.674s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:45 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.info is being set with open permissions: ugo+rw Jul 08 11:04:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:46 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.info Jul 08 11:04:46 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:46 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.729s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:04:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Deleted volume successfully. Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-b780dc06-2239-43c0-a943-bad3a3b36a11 tempest-ProjectReaderTests-875080478 None] Lock "cinder-8278b0b7-2c76-41ba-a582-a588b4dfa342-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Flow 'volume_create_manager' (7f17e81b-ec70-42c4-9367-481301129890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f3d6a7-1aaa-41d1-be46-a1070bd09127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f3d6a7-1aaa-41d1-be46-a1070bd09127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183879450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e657cb37-927e-40d6-b1fb-2cf89a42da68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa76fa3faab44cbbb2388e0d44761d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:46Z,use_quota=True,user_id='5b29973515404a20a618c33ce3b081ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faf2537-17cc-4a36-9670-23a208593f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faf2537-17cc-4a36-9670-23a208593f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d659f4f4-a071-44c2-89ee-488cb8c2a90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d659f4f4-a071-44c2-89ee-488cb8c2a90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e657cb37-927e-40d6-b1fb-2cf89a42da68', 'volume_name': 'volume-e657cb37-927e-40d6-b1fb-2cf89a42da68', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adefdbd7-cf76-4c56-9ea2-740f15fa6618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adefdbd7-cf76-4c56-9ea2-740f15fa6618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb40539-6b6f-4e32-9ae9-ebff05ec3896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:46 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Volume e657cb37-927e-40d6-b1fb-2cf89a42da68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e657cb37-927e-40d6-b1fb-2cf89a42da68', 'volume_size': 1} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:46 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.info" returned: 0 in 0.668s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.494s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.212s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183879450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e657cb37-927e-40d6-b1fb-2cf89a42da68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa76fa3faab44cbbb2388e0d44761d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:46Z,use_quota=True,user_id='5b29973515404a20a618c33ce3b081ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Creating volume e657cb37-927e-40d6-b1fb-2cf89a42da68 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:04:46 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:04:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:46 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 1073741824 Jul 08 11:04:46 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:46 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-491da9f4-fcea-40ac-b288-2313ebba7ba8 tempest-ProjectMemberTests-1421652484 None] Create snapshot completed successfully Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-2cb734c7-4124-4d73-a5f4-09f3c1c879bd-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-2cb734c7-4124-4d73-a5f4-09f3c1c879bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-7710b2e7-f028-4f90-9d9e-9e8d544fc432" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-7710b2e7-f028-4f90-9d9e-9e8d544fc432" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-2cb734c7-4124-4d73-a5f4-09f3c1c879bd" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-2cb734c7-4124-4d73-a5f4-09f3c1c879bd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Deleting offline snapshot 2cb734c7-4124-4d73-a5f4-09f3c1c879bd of volume 7710b2e7-f028-4f90-9d9e-9e8d544fc432 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] snapshot_file for this snap is: volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b2287a-8bbf-43fc-a93e-ee47ebb55b84]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:47 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 1073741824" returned: 0 in 0.923s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:47 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 Jul 08 11:04:47 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:47 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd Jul 08 11:04:47 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:48 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd" returned: 0 in 0.795s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:04:48 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68" returned: 0 in 0.740s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:04:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:48 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[41759d94-b605-48e1-8798-0788e09dbee9]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb40539-6b6f-4e32-9ae9-ebff05ec3896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e657cb37-927e-40d6-b1fb-2cf89a42da68', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d07caf9-2f8b-413c-92d5-1f50af664f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:48 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Volume volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 (e657cb37-927e-40d6-b1fb-2cf89a42da68): created successfully Jul 08 11:04:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d07caf9-2f8b-413c-92d5-1f50af664f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:48 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Flow 'volume_create_manager' (7f17e81b-ec70-42c4-9367-481301129890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:48 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-50977058-5c8f-43e5-a5af-6221563bc803 tempest-ProjectReaderTests-875080478 None] Created volume successfully. Jul 08 11:04:48 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 Jul 08 11:04:48 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:49 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432" returned: 0 in 0.769s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:49 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd Jul 08 11:04:49 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:49 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] Creating offline snapshot 28a14932-2b12-4aa3-879c-04704c8b6791 of volume e657cb37-927e-40d6-b1fb-2cf89a42da68 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:04:49 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aeb488-d610-4e45-9af1-7e0acf62024c]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:49 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 Jul 08 11:04:49 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:49 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd" returned: 0 in 0.842s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:50 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd Jul 08 11:04:50 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:50 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68" returned: 0 in 0.816s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:50 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 1G Jul 08 11:04:50 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:50 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432.2cb734c7-4124-4d73-a5f4-09f3c1c879bd" returned: 0 in 0.754s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-2cb734c7-4124-4d73-a5f4-09f3c1c879bd" released by "_delete_snapshot" :: held 3.274s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-7710b2e7-f028-4f90-9d9e-9e8d544fc432" released by "delete_snapshot" :: held 3.300s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:50 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Created reservations ['e6ed27f6-739e-4bc6-baab-65d72425d929', '05811d8c-8945-4bbb-8b74-127a70aa77e0', '74b72226-0109-49c5-9d54-8942a6f7018d', '12211abb-88a4-478a-a6a3-7833b67b9321'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:50 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Delete snapshot completed successfully. Jul 08 11:04:50 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-55fb5020-14e2-49de-8b5b-ab22fc59e514 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-2cb734c7-4124-4d73-a5f4-09f3c1c879bd-delete_snapshot" released by "delete_snapshot" :: held 3.456s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:51 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 1G" returned: 0 in 0.821s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:51 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 Jul 08 11:04:51 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-7710b2e7-f028-4f90-9d9e-9e8d544fc432-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-7710b2e7-f028-4f90-9d9e-9e8d544fc432-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-7710b2e7-f028-4f90-9d9e-9e8d544fc432" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:51 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-7710b2e7-f028-4f90-9d9e-9e8d544fc432" acquired by "delete_volume" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:51 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70fd86e-aace-476a-980d-fc3fc64f0ef5]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:51 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 Jul 08 11:04:51 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:52 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791" returned: 0 in 0.712s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:52 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 is being set with open permissions: ugo+rw Jul 08 11:04:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:52 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 Jul 08 11:04:52 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:52 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432" returned: 0 in 0.829s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:52 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432 Jul 08 11:04:52 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:52 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791" returned: 0 in 0.649s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:52 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.info Jul 08 11:04:52 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:53 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-7710b2e7-f028-4f90-9d9e-9e8d544fc432" returned: 0 in 0.722s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-7710b2e7-f028-4f90-9d9e-9e8d544fc432" released by "delete_volume" :: held 1.609s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Created reservations ['a1351b83-868b-49c5-8934-31155327271a', '852258a2-c441-4a39-bc6d-6985e691c733', '3999dfaf-8711-41c0-b738-a2c5148850c0', '55b0ccd5-7581-4010-96bf-5b6707916208'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:53 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.info" returned: 0 in 0.726s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:53 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.info is being set with open permissions: ugo+rw Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:53 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.info Jul 08 11:04:53 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:53 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:04:53 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:53 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:04:53 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:54 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.info" returned: 0 in 0.772s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.592s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:54 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-ea951db6-1413-4449-95c5-5def8d3ec138 tempest-ProjectReaderTests-875080478 None] Create snapshot completed successfully Jul 08 11:04:54 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.831s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:04:54 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Deleted volume successfully. Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-66b828c2-3cef-476d-8a7e-c068a82c84d6 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-7710b2e7-f028-4f90-9d9e-9e8d544fc432-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (2e321b0f-b8c7-4cde-b5fc-639fcfaeaa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc297b72-7826-41e9-8de5-2ee051a11792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc297b72-7826-41e9-8de5-2ee051a11792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1854574932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221eb21c-21e5-4beb-9778-c8c747700ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:54Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217a1e68-b0e3-48a1-a8f2-c16d38f93ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217a1e68-b0e3-48a1-a8f2-c16d38f93ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d186f326-0bb9-4d53-89a3-254d53ccc6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d186f326-0bb9-4d53-89a3-254d53ccc6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '221eb21c-21e5-4beb-9778-c8c747700ee5', 'volume_name': 'volume-221eb21c-21e5-4beb-9778-c8c747700ee5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c29fe4-6bf4-42f5-aa6d-936b5dadae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c29fe4-6bf4-42f5-aa6d-936b5dadae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff7b9c4-c0fd-4632-b5bc-af8b9bcdcd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:54 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Volume 221eb21c-21e5-4beb-9778-c8c747700ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-221eb21c-21e5-4beb-9778-c8c747700ee5', 'volume_size': 1} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1854574932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221eb21c-21e5-4beb-9778-c8c747700ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:04:54Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Creating volume 221eb21c-21e5-4beb-9778-c8c747700ee5 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:04:54 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:54 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 1073741824 Jul 08 11:04:54 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:54 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.772s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-28a14932-2b12-4aa3-879c-04704c8b6791-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Lock "cinder-28a14932-2b12-4aa3-879c-04704c8b6791-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-e657cb37-927e-40d6-b1fb-2cf89a42da68" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-e657cb37-927e-40d6-b1fb-2cf89a42da68" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:54 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-28a14932-2b12-4aa3-879c-04704c8b6791" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-28a14932-2b12-4aa3-879c-04704c8b6791" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Deleting offline snapshot 28a14932-2b12-4aa3-879c-04704c8b6791 of volume e657cb37-927e-40d6-b1fb-2cf89a42da68 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] snapshot_file for this snap is: volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd233a81-203e-473d-bf9e-24c49dda5176]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:55 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 Jul 08 11:04:55 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:55 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 1073741824" returned: 0 in 0.907s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:INSERT=42,cinder:UPDATE=145,cinder:SELECT=110,cinder:DELETE=11 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=131,cinder:INSERT=42,cinder:UPDATE=164,cinder:DELETE=15 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:55 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 Jul 08 11:04:55 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:55 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791" returned: 0 in 0.848s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e657cb37-927e-40d6-b1fb-2cf89a42da68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20c38e3-f187-4966-bc96-0d07b167730d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:56 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 Jul 08 11:04:56 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:56 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5" returned: 0 in 0.735s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff7b9c4-c0fd-4632-b5bc-af8b9bcdcd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-221eb21c-21e5-4beb-9778-c8c747700ee5', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fecdba5a-0ff0-4f0e-9c65-887808058f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:04:56 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Volume volume-221eb21c-21e5-4beb-9778-c8c747700ee5 (221eb21c-21e5-4beb-9778-c8c747700ee5): created successfully Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fecdba5a-0ff0-4f0e-9c65-887808058f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (2e321b0f-b8c7-4cde-b5fc-639fcfaeaa8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:04:56 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-32b3eae1-d8fa-4dba-8dc7-79a15616ad89 tempest-ProjectMemberTests-1421652484 None] Created volume successfully. Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] Creating offline snapshot e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 of volume 221eb21c-21e5-4beb-9778-c8c747700ee5 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[4704bd3a-10ef-4abb-9628-1b71ad6ddcab]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:56 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68" returned: 0 in 0.814s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:56 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 Jul 08 11:04:56 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:56 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 Jul 08 11:04:56 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:57 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791" returned: 0 in 0.754s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:57 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5" returned: 0 in 0.805s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:57 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791 Jul 08 11:04:57 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:57 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 1G Jul 08 11:04:57 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:58 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68.28a14932-2b12-4aa3-879c-04704c8b6791" returned: 0 in 0.722s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-28a14932-2b12-4aa3-879c-04704c8b6791" released by "_delete_snapshot" :: held 3.246s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-e657cb37-927e-40d6-b1fb-2cf89a42da68" released by "delete_snapshot" :: held 3.274s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:58 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Created reservations ['937e60fe-d5b7-4525-8ef0-bb64d697f9a9', '15460f07-b92f-4c2b-ba13-1c8dfb8c0dec', '885bb71b-c46a-46a6-9b9b-abceddf5e851', '9b02c057-d390-42d9-b3df-20d9b0b4a4f5'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:04:58 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:58 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Delete snapshot completed successfully. Jul 08 11:04:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 1G" returned: 0 in 0.884s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221eb21c-21e5-4beb-9778-c8c747700ee5 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:58 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cb09c5e3-ee8c-4ead-9ee1-816f0daf37a9 tempest-ProjectReaderTests-875080478 None] Lock "cinder-28a14932-2b12-4aa3-879c-04704c8b6791-delete_snapshot" released by "delete_snapshot" :: held 3.446s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:04:58 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221eb21c-21e5-4beb-9778-c8c747700ee5 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 Jul 08 11:04:58 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:59 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221eb21c-21e5-4beb-9778-c8c747700ee5 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12" returned: 0 in 0.728s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:59 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 is being set with open permissions: ugo+rw Jul 08 11:04:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:59 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 Jul 08 11:04:59 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-e657cb37-927e-40d6-b1fb-2cf89a42da68-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Lock "cinder-e657cb37-927e-40d6-b1fb-2cf89a42da68-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Acquiring lock "cinder-quobyte-e657cb37-927e-40d6-b1fb-2cf89a42da68" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:04:59 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-e657cb37-927e-40d6-b1fb-2cf89a42da68" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:04:59 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe266a43-37a8-4b2a-8e2f-5f2937521e9f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:04:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:59 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 Jul 08 11:04:59 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:04:59 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 08 11:04:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12" returned: 0 in 0.701s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:04:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:04:59 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.info Jul 08 11:04:59 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:00 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68" returned: 0 in 0.760s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:00 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68 Jul 08 11:05:00 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:00 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.info" returned: 0 in 0.700s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:00 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.info is being set with open permissions: ugo+rw Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:00 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.info Jul 08 11:05:00 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:00 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e657cb37-927e-40d6-b1fb-2cf89a42da68" returned: 0 in 0.743s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Lock "cinder-quobyte-e657cb37-927e-40d6-b1fb-2cf89a42da68" released by "delete_volume" :: held 1.579s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Created reservations ['81d6a9db-863d-4a2b-9776-01d65da74cd4', '7b04f004-21cb-457f-8619-30423eb841f8', 'b49900a6-877f-4aa3-82ba-9faa0684e14b', '28934744-1594-4db4-8d35-ec1582db4d54'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:01 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:05:01 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:01 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.info" returned: 0 in 0.704s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.616s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:01 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-3df2cbbf-e81f-4d52-a36c-b86487e0312b tempest-ProjectMemberTests-1421652484 None] Create snapshot completed successfully Jul 08 11:05:01 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.677s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:05:01 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Deleted volume successfully. Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c24787e5-d51c-49dd-a302-a82c316c2e19 tempest-ProjectReaderTests-875080478 None] Lock "cinder-e657cb37-927e-40d6-b1fb-2cf89a42da68-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-e27ee0aa-338f-4540-bcbc-6c00dfb7ac12-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-e27ee0aa-338f-4540-bcbc-6c00dfb7ac12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-221eb21c-21e5-4beb-9778-c8c747700ee5" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-221eb21c-21e5-4beb-9778-c8c747700ee5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-e27ee0aa-338f-4540-bcbc-6c00dfb7ac12" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-e27ee0aa-338f-4540-bcbc-6c00dfb7ac12" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:01 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Deleting offline snapshot e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 of volume 221eb21c-21e5-4beb-9778-c8c747700ee5 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:05:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] snapshot_file for this snap is: volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:05:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a10e46-b40f-456a-ab00-192997aa7159]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:02 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 Jul 08 11:05:02 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:02 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12" returned: 0 in 0.876s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221eb21c-21e5-4beb-9778-c8c747700ee5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:05:02 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d17d5bb-4028-45db-b15a-f621bf41be75]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:03 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 Jul 08 11:05:03 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:03 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5" returned: 0 in 0.794s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:03 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 Jul 08 11:05:03 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:04 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12" returned: 0 in 0.788s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:04 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12 Jul 08 11:05:04 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:05 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5.e27ee0aa-338f-4540-bcbc-6c00dfb7ac12" returned: 0 in 0.704s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-e27ee0aa-338f-4540-bcbc-6c00dfb7ac12" released by "_delete_snapshot" :: held 3.268s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-221eb21c-21e5-4beb-9778-c8c747700ee5" released by "delete_snapshot" :: held 3.297s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:05 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Created reservations ['a9eb97af-bd9b-43ad-8bf6-d2d1a4e62efe', 'a051eba1-1ce6-4346-b456-91529c68d09c', 'f14fb551-a731-484f-8fab-dcfc8ac3ab45', '41db5253-fdc0-4f1e-b820-a9966c6320a3'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:05:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Delete snapshot completed successfully. Jul 08 11:05:05 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-70ae2585-9e1a-4adf-90d3-d234f7f8e449 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-e27ee0aa-338f-4540-bcbc-6c00dfb7ac12-delete_snapshot" released by "delete_snapshot" :: held 3.460s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-221eb21c-21e5-4beb-9778-c8c747700ee5-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-221eb21c-21e5-4beb-9778-c8c747700ee5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-221eb21c-21e5-4beb-9778-c8c747700ee5" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:06 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-221eb21c-21e5-4beb-9778-c8c747700ee5" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:06 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6809490-28ec-438d-9db3-c31a555e9ba0]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:06 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 Jul 08 11:05:06 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:07 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5" returned: 0 in 0.824s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:07 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5 Jul 08 11:05:07 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:07 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-221eb21c-21e5-4beb-9778-c8c747700ee5" returned: 0 in 0.734s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:07 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-221eb21c-21e5-4beb-9778-c8c747700ee5" released by "delete_volume" :: held 1.637s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:07 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Created reservations ['91c7af06-b292-477b-b50e-5fc708959e6c', '872ea3a5-c262-4b6f-ba27-bb2c71a0cdc8', '1ed91934-0262-4bfe-ace4-d3f877250784', '106ce73d-691c-40cd-92f7-ecd2ba9d4826'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:08 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:05:08 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:08 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.712s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:05:08 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Deleted volume successfully. Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-7da118a4-2dd0-4287-a086-2fe717c3a1d8 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-221eb21c-21e5-4beb-9778-c8c747700ee5-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (65fc35c1-03a2-48bd-af40-83383060b0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:05:08 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571cab65-5bd1-44ac-8885-7a73a765f355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571cab65-5bd1-44ac-8885-7a73a765f355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467517862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b0b31d-8ac8-4895-b485-4386918f35f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:05:09Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d94b981-8494-4d6e-9b94-cc59c6886841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d94b981-8494-4d6e-9b94-cc59c6886841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b92b38-aa8e-467e-832c-084b7980e25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b92b38-aa8e-467e-832c-084b7980e25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b0b31d-8ac8-4895-b485-4386918f35f6', 'volume_name': 'volume-47b0b31d-8ac8-4895-b485-4386918f35f6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca44375f-af0a-4161-92dc-7ec7c8ca1ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca44375f-af0a-4161-92dc-7ec7c8ca1ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eaf82f-9095-4e16-b15d-7a8caf82f94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:09 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Volume 47b0b31d-8ac8-4895-b485-4386918f35f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b0b31d-8ac8-4895-b485-4386918f35f6', 'volume_size': 1} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467517862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b0b31d-8ac8-4895-b485-4386918f35f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:05:09Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Creating volume 47b0b31d-8ac8-4895-b485-4386918f35f6 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:05:09 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:09 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 1073741824 Jul 08 11:05:09 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:09 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 1073741824" returned: 0 in 0.916s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:10 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 Jul 08 11:05:10 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:10 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6" returned: 0 in 0.715s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:05:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eaf82f-9095-4e16-b15d-7a8caf82f94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b0b31d-8ac8-4895-b485-4386918f35f6', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa44169-fd93-43f7-aae2-5ba0ec6372bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:10 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Volume volume-47b0b31d-8ac8-4895-b485-4386918f35f6 (47b0b31d-8ac8-4895-b485-4386918f35f6): created successfully Jul 08 11:05:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa44169-fd93-43f7-aae2-5ba0ec6372bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:10 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (65fc35c1-03a2-48bd-af40-83383060b0c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:05:10 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-805b44d4-b905-413d-919a-b75c7c05facc tempest-ProjectMemberTests-1421652484 None] Created volume successfully. Jul 08 11:05:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] Creating offline snapshot b2da89bc-73ba-4b35-9ba1-d88e198c379c of volume 47b0b31d-8ac8-4895-b485-4386918f35f6 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:05:11 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae95ed4-9eca-4529-b7c3-c25d6a03548f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:11 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 Jul 08 11:05:11 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:12 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6" returned: 0 in 0.831s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:12 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c 1G Jul 08 11:05:12 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:12 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c 1G" returned: 0 in 0.865s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b0b31d-8ac8-4895-b485-4386918f35f6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:12 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b0b31d-8ac8-4895-b485-4386918f35f6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c Jul 08 11:05:12 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:13 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b0b31d-8ac8-4895-b485-4386918f35f6 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c" returned: 0 in 0.737s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:13 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c is being set with open permissions: ugo+rw Jul 08 11:05:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:13 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c Jul 08 11:05:13 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:14 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c" returned: 0 in 0.670s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:14 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:14 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.info Jul 08 11:05:14 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:15 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.info" returned: 0 in 0.712s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:15 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.info is being set with open permissions: ugo+rw Jul 08 11:05:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:15 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.info Jul 08 11:05:15 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:15 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.info" returned: 0 in 0.719s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.631s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:15 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-975c0256-b5af-44b5-ba9b-89a3659107e3 tempest-ProjectMemberTests-1421652484 None] Create snapshot completed successfully Jul 08 11:05:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-b2da89bc-73ba-4b35-9ba1-d88e198c379c-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-b2da89bc-73ba-4b35-9ba1-d88e198c379c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-47b0b31d-8ac8-4895-b485-4386918f35f6" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-47b0b31d-8ac8-4895-b485-4386918f35f6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-b2da89bc-73ba-4b35-9ba1-d88e198c379c" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-b2da89bc-73ba-4b35-9ba1-d88e198c379c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Deleting offline snapshot b2da89bc-73ba-4b35-9ba1-d88e198c379c of volume 47b0b31d-8ac8-4895-b485-4386918f35f6 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:05:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] snapshot_file for this snap is: volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:05:16 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[99922472-224d-49ba-96f6-ed3806f05886]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:16 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c Jul 08 11:05:16 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:17 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c" returned: 0 in 0.825s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:17 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47b0b31d-8ac8-4895-b485-4386918f35f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:05:17 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f7a4ae-6b64-4560-a04d-73ef1399ccaf]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:17 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 Jul 08 11:05:17 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:18 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6" returned: 0 in 0.760s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:18 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c Jul 08 11:05:18 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:18 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c" returned: 0 in 0.736s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:18 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:18 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c Jul 08 11:05:18 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:19 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:19 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6.b2da89bc-73ba-4b35-9ba1-d88e198c379c" returned: 0 in 0.647s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-b2da89bc-73ba-4b35-9ba1-d88e198c379c" released by "_delete_snapshot" :: held 3.066s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-47b0b31d-8ac8-4895-b485-4386918f35f6" released by "delete_snapshot" :: held 3.090s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:19 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Created reservations ['2f0ac464-37f2-46b2-8beb-7001efc1b6ef', 'b3429fef-790e-402d-9078-cd27e623bfd7', '06fe8614-3064-4697-b209-f1dcd7f701c0', '5bf81e26-1e95-4306-8a0c-13ac606607cb'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:05:19 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Delete snapshot completed successfully. Jul 08 11:05:19 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-59f207ff-275e-459d-8fbe-dab86ac74039 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-b2da89bc-73ba-4b35-9ba1-d88e198c379c-delete_snapshot" released by "delete_snapshot" :: held 3.222s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-47b0b31d-8ac8-4895-b485-4386918f35f6-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-47b0b31d-8ac8-4895-b485-4386918f35f6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-47b0b31d-8ac8-4895-b485-4386918f35f6" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:20 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-47b0b31d-8ac8-4895-b485-4386918f35f6" acquired by "delete_volume" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:20 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[334955c1-42e1-44ba-8cec-34eab8f4ad10]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:20 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:20 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 Jul 08 11:05:20 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:21 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6" returned: 0 in 0.743s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:21 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:21 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6 Jul 08 11:05:21 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:22 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-47b0b31d-8ac8-4895-b485-4386918f35f6" returned: 0 in 0.655s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:22 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-47b0b31d-8ac8-4895-b485-4386918f35f6" released by "delete_volume" :: held 1.453s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:22 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Created reservations ['63b5610c-e321-4c99-92a7-4374fa897806', '8d3ee0ca-2532-49a5-8b6b-da111fe46c42', '1f1fee95-aeb7-4f77-84a7-836d43fa4a03', 'c89251b5-3f30-455b-8fe0-4cba4023c201'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:05:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:05:22 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:05:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:22 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:05:22 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:22 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:22 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.658s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:22 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:05:23 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Deleted volume successfully. Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-c3059544-7f4a-4355-bd1d-7dc30393dc11 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-47b0b31d-8ac8-4895-b485-4386918f35f6-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (ace8d4f7-9d07-4a40-baca-d7b9782dc4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ec0e26-f9f2-4381-a8dc-59b4539115da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ec0e26-f9f2-4381-a8dc-59b4539115da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1800097836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af4431a-6b93-4640-8f61-181e5947b507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:05:23Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed3343a-4e28-4354-b2fc-5e4eea1633d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed3343a-4e28-4354-b2fc-5e4eea1633d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f1258b-e77b-4074-aee2-e4408f326ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f1258b-e77b-4074-aee2-e4408f326ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af4431a-6b93-4640-8f61-181e5947b507', 'volume_name': 'volume-8af4431a-6b93-4640-8f61-181e5947b507', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcdfc8a-3ba3-4be3-8ca0-f0da89d4ecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcdfc8a-3ba3-4be3-8ca0-f0da89d4ecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3557e75-e4ce-4547-985f-d6c35308212e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:23 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Volume 8af4431a-6b93-4640-8f61-181e5947b507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af4431a-6b93-4640-8f61-181e5947b507', 'volume_size': 1} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1800097836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af4431a-6b93-4640-8f61-181e5947b507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:05:23Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Creating volume 8af4431a-6b93-4640-8f61-181e5947b507 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:05:23 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:05:23 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:23 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 1073741824 Jul 08 11:05:23 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:24 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 1073741824" returned: 0 in 0.799s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:24 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 Jul 08 11:05:24 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:24 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507" returned: 0 in 0.666s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:24 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:05:24 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3557e75-e4ce-4547-985f-d6c35308212e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af4431a-6b93-4640-8f61-181e5947b507', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6c164a-f1f3-4382-bfb3-c90bf12ee37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:25 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Volume volume-8af4431a-6b93-4640-8f61-181e5947b507 (8af4431a-6b93-4640-8f61-181e5947b507): created successfully Jul 08 11:05:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6c164a-f1f3-4382-bfb3-c90bf12ee37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:25 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (ace8d4f7-9d07-4a40-baca-d7b9782dc4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:05:25 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-def21d3e-5172-409a-a29b-df4d98868022 tempest-ProjectMemberTests-1421652484 None] Created volume successfully. Jul 08 11:05:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:25 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] Creating offline snapshot e12fc13a-0f47-4683-8d11-8768eac4f890 of volume 8af4431a-6b93-4640-8f61-181e5947b507 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:05:25 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37780be-eaa0-44fe-9d1a-8ed1e50912b8]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:25 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:25 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 Jul 08 11:05:25 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:26 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507" returned: 0 in 0.751s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:26 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:26 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 1G Jul 08 11:05:26 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:27 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 1G" returned: 0 in 0.807s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af4431a-6b93-4640-8f61-181e5947b507 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:27 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af4431a-6b93-4640-8f61-181e5947b507 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 Jul 08 11:05:27 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:27 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af4431a-6b93-4640-8f61-181e5947b507 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890" returned: 0 in 0.698s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:27 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 is being set with open permissions: ugo+rw Jul 08 11:05:27 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:27 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 Jul 08 11:05:27 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:28 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890" returned: 0 in 0.628s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:28 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:28 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.info Jul 08 11:05:28 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:29 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.info" returned: 0 in 0.642s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:29 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.info is being set with open permissions: ugo+rw Jul 08 11:05:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:29 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.info Jul 08 11:05:29 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:29 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.info" returned: 0 in 0.632s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:29 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.236s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:29 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5f70441d-68f0-4872-b40c-dafae17c8331 tempest-ProjectMemberTests-1421652484 None] Create snapshot completed successfully Jul 08 11:05:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-e12fc13a-0f47-4683-8d11-8768eac4f890-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-e12fc13a-0f47-4683-8d11-8768eac4f890-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-8af4431a-6b93-4640-8f61-181e5947b507" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-8af4431a-6b93-4640-8f61-181e5947b507" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-e12fc13a-0f47-4683-8d11-8768eac4f890" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:30 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-e12fc13a-0f47-4683-8d11-8768eac4f890" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Deleting offline snapshot e12fc13a-0f47-4683-8d11-8768eac4f890 of volume 8af4431a-6b93-4640-8f61-181e5947b507 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:05:30 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] snapshot_file for this snap is: volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:05:30 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd39ba83-756a-4cca-a7d4-97ea32c4b2a5]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:30 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:31 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 Jul 08 11:05:31 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:31 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890" returned: 0 in 0.752s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:31 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8af4431a-6b93-4640-8f61-181e5947b507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:05:31 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1acddb-3516-4a34-b485-fdec385b4c14]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:31 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:31 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 Jul 08 11:05:31 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:32 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507" returned: 0 in 0.749s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:32 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:32 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 Jul 08 11:05:32 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:33 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890" returned: 0 in 0.720s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:33 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890 Jul 08 11:05:33 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:33 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:33 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507.e12fc13a-0f47-4683-8d11-8768eac4f890" returned: 0 in 0.645s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-e12fc13a-0f47-4683-8d11-8768eac4f890" released by "_delete_snapshot" :: held 2.954s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-8af4431a-6b93-4640-8f61-181e5947b507" released by "delete_snapshot" :: held 2.975s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:33 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Created reservations ['ed247be9-0350-4078-be79-cbf4a92cc59d', '3bffef90-b888-4960-8ec6-545979a8d108', 'f718ce63-f132-4933-8b1e-68adf6efec28', '8e4a4dd2-1f9b-4839-a7aa-ff184132341a'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:05:33 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Delete snapshot completed successfully. Jul 08 11:05:33 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-153e0726-d409-4f6f-8449-85ef2debe7d6 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-e12fc13a-0f47-4683-8d11-8768eac4f890-delete_snapshot" released by "delete_snapshot" :: held 3.110s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-8af4431a-6b93-4640-8f61-181e5947b507-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-8af4431a-6b93-4640-8f61-181e5947b507-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-8af4431a-6b93-4640-8f61-181e5947b507" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:34 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-8af4431a-6b93-4640-8f61-181e5947b507" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:34 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e5b0b-6520-4be1-91f7-5bb26ba0f323]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:34 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 Jul 08 11:05:34 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:34 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507" returned: 0 in 0.759s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:34 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:34 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507 Jul 08 11:05:34 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:35 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-8af4431a-6b93-4640-8f61-181e5947b507" returned: 0 in 0.649s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:35 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-8af4431a-6b93-4640-8f61-181e5947b507" released by "delete_volume" :: held 1.465s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:35 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Created reservations ['69685c41-e489-4065-8bad-ded701915b8f', '3ee8991b-c947-41dc-b646-d8557fa03094', '4d6e26e9-2502-4649-8370-b444ad265223', '57d66d91-586a-4c08-b250-51a308c15f5c'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:05:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:05:35 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:05:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:35 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:35 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:05:35 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:36 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.643s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:05:36 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Deleted volume successfully. Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-a120c29a-ab8c-4d1d-9d20-990d17ae8569 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-8af4431a-6b93-4640-8f61-181e5947b507-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (1a8be08b-8045-42be-b600-522d5844f1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1567b3-5aa2-4047-afe7-be8ff8c1c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1567b3-5aa2-4047-afe7-be8ff8c1c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105841507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91fb77d-f765-4a5a-bbf0-bb472ab79e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:05:37Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f99de5-1794-4a83-9ad3-a322e85640aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f99de5-1794-4a83-9ad3-a322e85640aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d683a6-1c89-4cf5-86cb-7f99ad9aa6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d683a6-1c89-4cf5-86cb-7f99ad9aa6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91fb77d-f765-4a5a-bbf0-bb472ab79e99', 'volume_name': 'volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d64bff4-d9c4-4076-902d-e650392c8ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d64bff4-d9c4-4076-902d-e650392c8ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6317ee97-c9d6-4c15-893c-89ff1fa27af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:36 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Volume e91fb77d-f765-4a5a-bbf0-bb472ab79e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99', 'volume_size': 1} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105841507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91fb77d-f765-4a5a-bbf0-bb472ab79e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:05:37Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Creating volume e91fb77d-f765-4a5a-bbf0-bb472ab79e99 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:05:36 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:05:36 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:36 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 1073741824 Jul 08 11:05:36 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:37 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 1073741824" returned: 0 in 0.831s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:37 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:37 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 Jul 08 11:05:37 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:38 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99" returned: 0 in 0.643s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6317ee97-c9d6-4c15-893c-89ff1fa27af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62483758-88ea-4d2c-b12c-6e882d1e9d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:38 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Volume volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 (e91fb77d-f765-4a5a-bbf0-bb472ab79e99): created successfully Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62483758-88ea-4d2c-b12c-6e882d1e9d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (1a8be08b-8045-42be-b600-522d5844f1f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:05:38 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-eee2d6f9-bcef-4f06-9fcb-b3340c536208 tempest-ProjectMemberTests-1421652484 None] Created volume successfully. Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] Creating offline snapshot 511be657-efc5-45ea-acd8-1f7e6e97f7da of volume e91fb77d-f765-4a5a-bbf0-bb472ab79e99 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d26a1a4-657b-420d-88a5-359359efc096]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:38 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:39 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 Jul 08 11:05:39 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:39 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99" returned: 0 in 0.755s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:39 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:39 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da 1G Jul 08 11:05:39 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:40 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da 1G" returned: 0 in 0.841s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:40 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:40 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da Jul 08 11:05:40 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:41 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da" returned: 0 in 0.686s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:41 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da is being set with open permissions: ugo+rw Jul 08 11:05:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:41 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da Jul 08 11:05:41 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:41 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da" returned: 0 in 0.650s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:41 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:41 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.info Jul 08 11:05:41 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:42 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.info" returned: 0 in 0.651s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:42 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.info is being set with open permissions: ugo+rw Jul 08 11:05:42 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:42 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.info Jul 08 11:05:42 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:43 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.info" returned: 0 in 0.664s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:43 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.325s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:43 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d52a077c-8955-4c5b-8a03-7504432ee586 tempest-ProjectMemberTests-1421652484 None] Create snapshot completed successfully Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-511be657-efc5-45ea-acd8-1f7e6e97f7da-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-511be657-efc5-45ea-acd8-1f7e6e97f7da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-e91fb77d-f765-4a5a-bbf0-bb472ab79e99" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-e91fb77d-f765-4a5a-bbf0-bb472ab79e99" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-511be657-efc5-45ea-acd8-1f7e6e97f7da" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-511be657-efc5-45ea-acd8-1f7e6e97f7da" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Deleting offline snapshot 511be657-efc5-45ea-acd8-1f7e6e97f7da of volume e91fb77d-f765-4a5a-bbf0-bb472ab79e99 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] snapshot_file for this snap is: volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[9347bf42-9f4c-4852-8d8e-e2de6b29abbb]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:44 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da Jul 08 11:05:44 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:44 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da" returned: 0 in 0.772s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:44 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:05:45 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5393991-aeb7-47fb-bafc-e083afa1ac78]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:45 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 Jul 08 11:05:45 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:45 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99" returned: 0 in 0.746s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:45 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:45 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da Jul 08 11:05:45 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:46 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da" returned: 0 in 0.719s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:46 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:46 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da Jul 08 11:05:46 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:47 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99.511be657-efc5-45ea-acd8-1f7e6e97f7da" returned: 0 in 0.645s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-511be657-efc5-45ea-acd8-1f7e6e97f7da" released by "_delete_snapshot" :: held 2.968s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-e91fb77d-f765-4a5a-bbf0-bb472ab79e99" released by "delete_snapshot" :: held 2.988s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:47 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Created reservations ['9ac460cd-406f-4b37-b2dc-9d82065b6ce2', 'a7fac48c-1844-496c-bf39-6bcc1b77b1fa', 'd8b03de4-1c9e-4123-9c4f-0fa2d8bb7877', 'a7e8fedb-587f-4487-90bf-e64be26881b6'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:05:47 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Delete snapshot completed successfully. Jul 08 11:05:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-cef3df61-0b8f-4a13-aaef-7c31d71bd504 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-511be657-efc5-45ea-acd8-1f7e6e97f7da-delete_snapshot" released by "delete_snapshot" :: held 3.121s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-e91fb77d-f765-4a5a-bbf0-bb472ab79e99-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Lock "cinder-e91fb77d-f765-4a5a-bbf0-bb472ab79e99-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-e91fb77d-f765-4a5a-bbf0-bb472ab79e99" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:47 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-e91fb77d-f765-4a5a-bbf0-bb472ab79e99" acquired by "delete_volume" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:47 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd07f9b6-acfc-4861-89b4-7b5f23933bac]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:47 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:47 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 Jul 08 11:05:47 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:48 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99" returned: 0 in 0.760s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:48 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99 Jul 08 11:05:48 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:48 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-e91fb77d-f765-4a5a-bbf0-bb472ab79e99" returned: 0 in 0.656s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:48 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-e91fb77d-f765-4a5a-bbf0-bb472ab79e99" released by "delete_volume" :: held 1.471s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:48 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Created reservations ['fae70b45-9135-4119-a072-52bdc121b6d1', '5496081c-1772-4ea1-841f-5a869ba23262', 'a265d0cf-2acd-4542-a15a-e3f2cb8d31b6', '28ede7d6-ab04-49cb-89fc-0666107b71ee'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:05:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:05:48 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:05:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:48 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:49 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:05:49 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:49 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:49 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.695s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:49 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:05:49 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Deleted volume successfully. Jul 08 11:05:49 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-90c50dc9-2866-49b9-8d66-b1f4c0903a6f tempest-ProjectMemberTests-1421652484 None] Lock "cinder-e91fb77d-f765-4a5a-bbf0-bb472ab79e99-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (79af5b76-e64d-4055-8678-5fbff529a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba275d0a-0e81-4e06-ae8b-8ba33318f579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba275d0a-0e81-4e06-ae8b-8ba33318f579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303246326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f552b88-d093-43ff-9755-6fd30a311b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:05:50Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fbf49a-670d-45ee-b2f6-c1100561052d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fbf49a-670d-45ee-b2f6-c1100561052d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4da35e9-2bc4-44c4-baa9-b2fc1027d14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4da35e9-2bc4-44c4-baa9-b2fc1027d14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f552b88-d093-43ff-9755-6fd30a311b07', 'volume_name': 'volume-4f552b88-d093-43ff-9755-6fd30a311b07', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e71def-7c61-4175-bf40-6a816fe9bbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e71def-7c61-4175-bf40-6a816fe9bbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fd36c9-1946-45fb-9154-fb83cd3692cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:50 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Volume 4f552b88-d093-43ff-9755-6fd30a311b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f552b88-d093-43ff-9755-6fd30a311b07', 'volume_size': 1} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303246326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f552b88-d093-43ff-9755-6fd30a311b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:05:50Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Creating volume 4f552b88-d093-43ff-9755-6fd30a311b07 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:05:50 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:50 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 1073741824 Jul 08 11:05:50 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:50 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:50 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 1073741824" returned: 0 in 0.832s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:51 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 Jul 08 11:05:51 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:51 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07" returned: 0 in 0.659s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:51 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:05:51 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fd36c9-1946-45fb-9154-fb83cd3692cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f552b88-d093-43ff-9755-6fd30a311b07', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e368e0d-6a51-4601-88b4-c8677f4cda16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:05:51 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Volume volume-4f552b88-d093-43ff-9755-6fd30a311b07 (4f552b88-d093-43ff-9755-6fd30a311b07): created successfully Jul 08 11:05:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e368e0d-6a51-4601-88b4-c8677f4cda16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:05:51 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (79af5b76-e64d-4055-8678-5fbff529a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:05:51 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4ba30e53-f16e-4ac2-9747-6f41cd60ad3e tempest-ProjectMemberTests-1421652484 None] Created volume successfully. Jul 08 11:05:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:52 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] Creating offline snapshot 94db5794-53de-4b6c-b00c-24d9d33ab96b of volume 4f552b88-d093-43ff-9755-6fd30a311b07 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:05:52 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b5d693-d3d1-4d89-9429-912f5467e176]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:52 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:52 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 Jul 08 11:05:52 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:53 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07" returned: 0 in 0.755s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:53 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b 1G Jul 08 11:05:53 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:53 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b 1G" returned: 0 in 0.822s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f552b88-d093-43ff-9755-6fd30a311b07 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:53 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f552b88-d093-43ff-9755-6fd30a311b07 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b Jul 08 11:05:53 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:05:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:05:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:05:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:05:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:05:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:53 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:05:53 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:54 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.635s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:05:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:05:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:05:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:05:54 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f552b88-d093-43ff-9755-6fd30a311b07 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b" returned: 0 in 0.733s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:54 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b is being set with open permissions: ugo+rw Jul 08 11:05:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:54 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b Jul 08 11:05:54 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:55 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b" returned: 0 in 0.648s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:55 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.info Jul 08 11:05:55 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:55 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.info" returned: 0 in 0.657s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:55 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.info is being set with open permissions: ugo+rw Jul 08 11:05:55 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:55 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.info Jul 08 11:05:55 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:56 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.info" returned: 0 in 0.641s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:56 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.351s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:05:56 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:UPDATE=77,cinder:SELECT=70,cinder:INSERT=23,cinder:DELETE=7 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:05:56 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=67,cinder:INSERT=27,cinder:UPDATE=101,cinder:DELETE=7 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:05:56 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-adf46c8c-44d1-45a9-a454-36d4c3005ff0 tempest-ProjectMemberTests-1421652484 None] Create snapshot completed successfully Jul 08 11:05:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-94db5794-53de-4b6c-b00c-24d9d33ab96b-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-94db5794-53de-4b6c-b00c-24d9d33ab96b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-4f552b88-d093-43ff-9755-6fd30a311b07" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-4f552b88-d093-43ff-9755-6fd30a311b07" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-94db5794-53de-4b6c-b00c-24d9d33ab96b" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:05:57 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-94db5794-53de-4b6c-b00c-24d9d33ab96b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:05:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Deleting offline snapshot 94db5794-53de-4b6c-b00c-24d9d33ab96b of volume 4f552b88-d093-43ff-9755-6fd30a311b07 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:05:57 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] snapshot_file for this snap is: volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:05:57 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba72d8f9-fc5b-41e5-b1f5-96b4ee9dc444]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:57 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:57 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b Jul 08 11:05:57 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:58 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b" returned: 0 in 0.763s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:58 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f552b88-d093-43ff-9755-6fd30a311b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:05:58 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[6104bad3-7bcf-4bbb-9c9c-d1a592ad2b3f]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:05:58 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:58 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 Jul 08 11:05:58 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:59 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07" returned: 0 in 0.752s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:59 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b Jul 08 11:05:59 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:59 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b" returned: 0 in 0.728s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:59 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:59 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b Jul 08 11:05:59 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:00 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07.94db5794-53de-4b6c-b00c-24d9d33ab96b" returned: 0 in 0.640s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-94db5794-53de-4b6c-b00c-24d9d33ab96b" released by "_delete_snapshot" :: held 2.966s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:06:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-4f552b88-d093-43ff-9755-6fd30a311b07" released by "delete_snapshot" :: held 2.988s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:06:00 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Created reservations ['b156072e-77b7-469d-b29c-dabc76f843b0', 'c3ab3089-e8e9-4d66-8824-fdf0b7c34508', 'a9f287d6-bbd9-431e-a263-dc55663b81a3', '8e1a75d7-de51-4f0b-8804-3d2d5c9cbccc'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:06:00 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Delete snapshot completed successfully. Jul 08 11:06:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-639347cb-b091-478a-a988-74e23df3b233 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-94db5794-53de-4b6c-b00c-24d9d33ab96b-delete_snapshot" released by "delete_snapshot" :: held 3.122s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:06:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-4f552b88-d093-43ff-9755-6fd30a311b07-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:06:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Lock "cinder-4f552b88-d093-43ff-9755-6fd30a311b07-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:06:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-4f552b88-d093-43ff-9755-6fd30a311b07" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:06:00 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-4f552b88-d093-43ff-9755-6fd30a311b07" acquired by "delete_volume" :: waited 0.015s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:06:00 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21b1a19-bde2-42f5-aff9-b8dff01d939d]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:06:00 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:00 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 Jul 08 11:06:00 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:01 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07" returned: 0 in 0.759s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:01 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:01 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07 Jul 08 11:06:01 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:02 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-4f552b88-d093-43ff-9755-6fd30a311b07" returned: 0 in 0.641s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:02 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-4f552b88-d093-43ff-9755-6fd30a311b07" released by "delete_volume" :: held 1.459s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:06:02 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Created reservations ['49696479-b5be-4071-b98f-6d5ee431d09a', 'dfe0c40c-62ca-4e1f-8df0-3785d8d18464', 'f14aef30-3611-487e-bf1f-770a9115f36d', 'a4e5678b-ea26-4ba5-9a78-53beb19d2f14'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:06:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:06:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:06:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:06:02 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:06:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:06:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:02 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:06:02 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:02 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:02 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.653s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:02 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:06:02 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Deleted volume successfully. Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-8418444c-39fa-483f-899d-5daa9573618a tempest-ProjectMemberTests-1421652484 None] Lock "cinder-4f552b88-d093-43ff-9755-6fd30a311b07-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86913) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (201cbbdd-1a64-4cb2-b264-cb94e82d2704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7b1234-adf3-47c2-be6a-f5dec8c178b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7b1234-adf3-47c2-be6a-f5dec8c178b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575145377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395be811-3443-4d9d-9bba-552eb0c0f711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:06:03Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa894f2-16b1-4955-8224-da5434e8904d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa894f2-16b1-4955-8224-da5434e8904d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84512863-562b-43fb-b1d1-c8526d896e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84512863-562b-43fb-b1d1-c8526d896e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395be811-3443-4d9d-9bba-552eb0c0f711', 'volume_name': 'volume-395be811-3443-4d9d-9bba-552eb0c0f711', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a963b3e0-ff8a-49d0-aa6f-23bfcba32733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a963b3e0-ff8a-49d0-aa6f-23bfcba32733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6d91e7-a84a-48a2-be1e-76dc10044e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:06:03 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Volume 395be811-3443-4d9d-9bba-552eb0c0f711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395be811-3443-4d9d-9bba-552eb0c0f711', 'volume_size': 1} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575145377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395be811-3443-4d9d-9bba-552eb0c0f711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a449f5500a0483ba368487a9e28c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:06:03Z,use_quota=True,user_id='d2a56d4cb8b4429d92480dbe980715a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d739a0eb-6623-4df0-ab7f-e3e344a1098c),volume_type_id=d739a0eb-6623-4df0-ab7f-e3e344a1098c)}" {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Creating volume 395be811-3443-4d9d-9bba-552eb0c0f711 {{(pid=86913) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Selected osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 as target Quobyte volume. {{(pid=86913) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:06:03 devstack cinder-volume[86913]: INFO cinder.volume.drivers.remotefs [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] casted to osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98 Jul 08 11:06:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 1073741824 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:03 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 1073741824 Jul 08 11:06:03 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:04 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 1073741824" returned: 0 in 0.811s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:04 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 Jul 08 11:06:04 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:04 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711" returned: 0 in 0.629s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'} {{(pid=86913) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:06:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:06:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6d91e7-a84a-48a2-be1e-76dc10044e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395be811-3443-4d9d-9bba-552eb0c0f711', 'volume_size': 1}' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:06:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f43caaf-a03a-4345-b7e4-ab409536bb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:06:04 devstack cinder-volume[86913]: INFO cinder.volume.flows.manager.create_volume [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Volume volume-395be811-3443-4d9d-9bba-552eb0c0f711 (395be811-3443-4d9d-9bba-552eb0c0f711): created successfully Jul 08 11:06:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f43caaf-a03a-4345-b7e4-ab409536bb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86913) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:06:04 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Flow 'volume_create_manager' (201cbbdd-1a64-4cb2-b264-cb94e82d2704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86913) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:06:04 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-4b8696e7-a8da-42b3-b301-8521a62b53d0 tempest-ProjectMemberTests-1421652484 None] Created volume successfully. Jul 08 11:06:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:06:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:06:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] Creating offline snapshot c0ac6264-f052-4b9e-9d49-acdaabbb44fe of volume 395be811-3443-4d9d-9bba-552eb0c0f711 {{(pid=86913) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:06:05 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c0285a-8324-43e3-905e-f9512e28d716]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:06:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:05 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 Jul 08 11:06:05 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:06 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711" returned: 0 in 0.746s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:06 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe 1G {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:06 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe 1G Jul 08 11:06:06 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:07 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe 1G" returned: 0 in 0.795s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395be811-3443-4d9d-9bba-552eb0c0f711 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:07 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395be811-3443-4d9d-9bba-552eb0c0f711 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe Jul 08 11:06:07 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:07 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395be811-3443-4d9d-9bba-552eb0c0f711 -F qcow2 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe" returned: 0 in 0.682s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:07 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe is being set with open permissions: ugo+rw Jul 08 11:06:07 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:07 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe Jul 08 11:06:07 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:08 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe" returned: 0 in 0.634s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:08 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.info Jul 08 11:06:08 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:09 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.info" returned: 0 in 0.637s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:09 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.remotefs [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.info is being set with open permissions: ugo+rw Jul 08 11:06:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.info {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:09 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.info Jul 08 11:06:09 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:09 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.info" returned: 0 in 0.653s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.226s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:06:09 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-1c9bf34d-2bdc-45ff-8f96-12c8513e0134 tempest-ProjectMemberTests-1421652484 None] Create snapshot completed successfully Jul 08 11:06:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-c0ac6264-f052-4b9e-9d49-acdaabbb44fe-delete_snapshot" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:06:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Lock "cinder-c0ac6264-f052-4b9e-9d49-acdaabbb44fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:06:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-395be811-3443-4d9d-9bba-552eb0c0f711" by "delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:06:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-395be811-3443-4d9d-9bba-552eb0c0f711" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:06:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-c0ac6264-f052-4b9e-9d49-acdaabbb44fe" by "_delete_snapshot" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:06:10 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-c0ac6264-f052-4b9e-9d49-acdaabbb44fe" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:06:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Deleting offline snapshot c0ac6264-f052-4b9e-9d49-acdaabbb44fe of volume 395be811-3443-4d9d-9bba-552eb0c0f711 {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:06:10 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] snapshot_file for this snap is: volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe {{(pid=86913) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:06:10 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c54b2f-a0b9-4ac8-a984-a24064d5da7a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:06:10 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:11 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe Jul 08 11:06:11 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:11 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe" returned: 0 in 0.749s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:11 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-395be811-3443-4d9d-9bba-552eb0c0f711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86913) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:06:11 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffd0884-e1d7-4331-8875-e551701a520a]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:06:11 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:11 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 Jul 08 11:06:11 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:12 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711" returned: 0 in 0.757s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:12 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:12 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe Jul 08 11:06:12 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:13 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe" returned: 0 in 0.748s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:13 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe Jul 08 11:06:13 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:13 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711.c0ac6264-f052-4b9e-9d49-acdaabbb44fe" returned: 0 in 0.710s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-c0ac6264-f052-4b9e-9d49-acdaabbb44fe" released by "_delete_snapshot" :: held 3.043s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:06:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-395be811-3443-4d9d-9bba-552eb0c0f711" released by "delete_snapshot" :: held 3.064s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:06:14 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Created reservations ['03b730e5-f1df-41da-b75b-094839b84b66', 'f9a0422e-9535-4e66-874e-d575e2b7bb14', 'b937060c-86ed-41d0-8735-d923373cd239', '5cc00a3c-6427-44ed-b500-e88e93e21e65'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:06:14 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Delete snapshot completed successfully. Jul 08 11:06:14 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-d43dc59d-d55d-4d49-b5c6-7fc073d5c49f tempest-ProjectMemberTests-1421652484 None] Lock "cinder-c0ac6264-f052-4b9e-9d49-acdaabbb44fe-delete_snapshot" released by "delete_snapshot" :: held 3.198s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:06:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-395be811-3443-4d9d-9bba-552eb0c0f711-delete_volume" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:06:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-395be811-3443-4d9d-9bba-552eb0c0f711-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:06:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "cinder-quobyte-395be811-3443-4d9d-9bba-552eb0c0f711" by "delete_volume" {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:06:15 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-395be811-3443-4d9d-9bba-552eb0c0f711" acquired by "delete_volume" :: waited 0.014s {{(pid=86913) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:06:15 devstack cinder-volume[86913]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6baa1f5-3854-4908-8841-ed234c77d160]: (4, 'qcow2') {{(pid=88000) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:06:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:15 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 Jul 08 11:06:15 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:15 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711" returned: 0 in 0.747s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:15 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:16 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711 Jul 08 11:06:16 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:16 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d/volume-395be811-3443-4d9d-9bba-552eb0c0f711" returned: 0 in 0.641s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:16 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-quobyte-395be811-3443-4d9d-9bba-552eb0c0f711" released by "delete_volume" :: held 1.442s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:06:16 devstack cinder-volume[86913]: DEBUG cinder.quota [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Created reservations ['f8d6cca4-a9a2-4ace-8c2a-3bef21985c32', '3cbe351e-b772-4b83-8c31-65e66ef2dd50', '30e736e3-6def-460e-80f6-3481362de195', '39cef30b-4636-41e9-9997-48759a29f11f'] {{(pid=86913) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:06:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:06:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:06:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:06:16 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:06:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:06:16 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:16 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:06:16 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:17 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:17 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.668s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:17 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:06:17 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Deleted volume successfully. Jul 08 11:06:17 devstack cinder-volume[86913]: DEBUG cinder.coordination [None req-5cf487fe-842c-4c2e-b010-388fcf215976 tempest-ProjectMemberTests-1421652484 None] Lock "cinder-395be811-3443-4d9d-9bba-552eb0c0f711-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=86913) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:06:26 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:SELECT=24,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:06:27 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writing DB stats cinder:DELETE=3,cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=34 {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:06:53 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:06:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:06:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:06:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:06:53 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7247d7d9-2cf7-46a1-9960-69b1d9d7bc98'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:06:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:06:53 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:53 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d Jul 08 11:06:53 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:54 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:54 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c52e72566363217873ec97f9233bed5d" returned: 0 in 0.708s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:54 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:06:54 devstack cinder-volume[86913]: DEBUG oslo_service.periodic_task [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] Running periodic task VolumeManager._thread_info {{(pid=86913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:06:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread count: 28 {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:06:54 devstack cinder-volume[86913]: DEBUG cinder.volume.manager [None req-ab1e848a-1c8a-43c0-a204-bca9904261af None None] thread info: [<_MainThread(MainThread, started 125785611886720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}